Skip to content

GLAM data from government portals

This is an attempt to assemble some useful information about Australian GLAM (Galleries, Libraries, Archives, Museums) datasets.

As a first step, I've harvested GLAM-related datasets from the various national and state data portals.

You can browse a list of datasets, or download a CSV containing all the harvested data or just the CSVs. You can also search the harvested data using Datasette on Glitch.

To start exploring the contents of the datasets, give the GLAM CSV Explorer a spin.

To search across 195 datasets containing names, try the GLAM Name Index Search.

Binder

Tools, tips, and examples

Harvesting GLAM data from government portals

This notebook attempts to harvest the details of GLAM datasets from state and national data portals. I did this by identifying relevant organisations, tags, and queries, and then harvesting all the packages associated with them. It also attempts some analysis of the results.

Harvest GLAM datasets from data.gov.au

This is a quick attempt to harvest datasets published by GLAM institutions using the new data.gov.au API. To create the list of organisations, I searched the organisations on the data.gov.au site for 'library', 'archives', 'records', and 'museum'. Note that due to a problem with duplicates on data.gov.au, I'm no longer using this notebook to harvest the data.

Data

Results (16 October 2021)

Summary

Number of datasets: 413 (datasets can contain multiple files)
Number of files: 1076

Files by organisation:

State Library of Queensland                                                   277
Queensland State Archives                                                     197
State Library of South Australia                                              135
Libraries Tasmania                                                             85
South Australian Museum                                                        74
State Library of Western Australia                                             73
Public Records Office Victoria                                                 56
Queensland Museum                                                              49
State Records South Australia                                                  30
History Trust of South Australia                                               20
NSW State Archives                                                             19
Western Australian Museum                                                      19
State Records Office of Western Australia                                      13
State Library of NSW                                                            5
State Library of Victoria                                                       5
National Library of Australia                                                   5
National Archives of Australia                                                  3
Australian Institute of Aboriginal and Torres Strait Islander Studies (AIATSIS) 3
Museum of Applied Arts and Sciences                                             3
Mount Gambier Library                                                           2
National Portrait Gallery                                                       2
Museums Victoria                                                                1

Files by format:

CSV                              711
JSON                              78
XML                               61
XLSX                              50
ZIP                               22
JPG                               17
JPEG                              15
RTF                               15
HTML                              12
API                               10
DOC                               10
TXT                                9
DOCX                               8
website link                       7
OBJ                                7
MTL                                5
API ArcGIS Server Map Service      4
GeoJSON                            4
Mixed Formats                      4
KML                                2
WMS                                2
RSS                                2
GEOJSON                            2
                                   2
PDF                                2
TIF                                1
JS                                 1
MPK                                1
plain                              1
WFS                                1
.txt                               1
api                                1
PHP                                1
page                               1
CSS, Java, PHP, JavaScript         1
Website                            1
RDF                                1
XSD                                1
MUSEUM                             1
app                                

Files by licence:

Creative Commons Attribution 4.0                                      611
Creative Commons Attribution                                          275
Creative Commons Attribution 4.0 International                        121
Creative Commons Attribution 2.5 Australia                             27
Creative Commons Attribution-NonCommercial                              9
Creative Commons Attribution 3.0 Australia                              8
Creative Commons Attribution 3.0                                        7
                                                                        4
Other (Open)                                                            4
notspecified                                                            3
Creative Commons Attribution Share-Alike 4.0                            3
Creative Commons Attribution Non-Commercial 4.0                         2
Creative Commons Attribution No Derivative Works 4.0 International      1
Custom (Other)                                                          1

Cite as

Sherratt, Tim. (2019, November 21). GLAM-Workbench/ozglam-data (Version v0.1.0). Zenodo. http://doi.org/10.5281/zenodo.3549113

DOI