Unfortunately Archway doesn't provide access to machine-readable data through an API, so we have to resort to screen scraping.
Tools, tips, and examples¶
Harvesting a records search¶
This notebook includes code that will enable you to harvest individual record details from a search in Archway. There's a limit of 10,000 results returned for any search, so if you want to harvest more records than this, you'll need to break your search up into chunks of less than 10,000 — the notebook provides some examples of how you might do this.
Functions provide an alternative way of finding relevant series and records — zooming out from the records to focus on the government activities you're interested in. Functions also provide an interesting data point to analyse and visualise. This notebook lets you download the functions used by Archway as a dataset.
Archives New Zealand divides government activities up into 303 functions. Over time, different agencies have been made responsible for these functions, and it can be interesting to track how these responsibilities have shifted. This notebook uses data about functions harvested from Archway to create a a simple visualisation of the agencies responsible for a selected function.
Sherratt, Tim. (2019, November 17). GLAM-Workbench/archway-harvesting (Version v0.1.0). Zenodo. http://doi.org/10.5281/zenodo.3544700