Partnership to expand access to government archives
The Boston Public Library, one of the nation’s oldest and largest public library systems, has begun a project with Harvard University researchers and artificial intelligence specialists to expand access to its extensive collection of historic government documents.
The archive includes congressional reports, oral histories, and studies of various industries and communities, some dating back to the early 1800s.
Digitization process and metadata enhancement
Currently, access to these materials requires visiting the library in person. The new initiative aims to digitize and enhance the metadata of each document, enabling users to search and cross-reference content online from anywhere in the world. The initial goal is to digitize 5,000 documents by the end of the year, with potential for expansion.
Given the collection’s size and fragility, each item must be scanned manually, a process that takes about an hour for 300 to 400 pages.
Advantages and challenges of collaboration
Library professionals oversee the curation and categorization process to ensure accuracy and data integrity. Once digitized, the materials will be publicly available without exclusive access for participating companies.
The project is expected to improve access to public domain information and enhance the quality of datasets used in AI systems. However, experts also note potential challenges due to cultural differences between the slower, methodical pace of libraries and the rapid development approach of technology companies.
