Harvest of unique urls from the gov.au domain
Harvested in April 2022
This is a dataset of (mostly unique) urls in the gov.au domain harvested using the IA CDX API. It is saved as newline-delimited JSON, with one JSON object per line. Each JSON object contains the following fields:
||The domain of the url in SURT (Sort-friendly URI Reordering Transform) format|
||Time and date when the url was captured|
||The archived url|
Sherratt, Tim & Jackson, Andrew. (2022). GLAM-Workbench/web-archives (version v1.1.0). Zenodo. https://doi.org/10.5281/zenodo.6450762
The Web Archives section of the GLAM Workbench is sponsored by the British Library.