1
NEW YORK UNIVERSITY
HISTORY DEPARTMENT
Digital Archives
HIST-GA 2162
Fall 2015
Donald Mennerich
don.mennerich@nyu.edu
(212) 992-6264
office hours: Mondays 4-6pm
Course Objectives:
●
●
Describe the role of archivists across the life-cycle of digital archives.
Articulate challenges, best practices, and standards associated with the appraisal, acquisition,
storage, and provision of access to digital archives.
● Design basic workflows for the accession and ingest of digital archives.
● Identify risks and threats to the successful preservation of digital archives in various file
formats.
● Enumerate important considerations in institutional policies and plans related to collection
development, intellectual property rights, preservation, and overall sustainability.
● Test and recommend open-source software associated with various preservation activities.
● Communicate essential digital preservation goals and objectives to Archival and IT staff.
Grading:
●
●
●
●
●
●
In-Class Participation, Exercises, and Discussion Board Postings: 25%
Conceptual Models Reaction Paper (due Week 2): 15%
Preservation Policy Comparison (due Week 4): 15%
File Format Report (due Week 6): 10%
Repository Software Report and Presentation (due Week 9): 10%
Final Project (due Week 14) 25%
Textbook:
Kirschenbaum, Matthew. Mechanisms. Cambridge: MIT Press, 2008.
http://www.amazon.com/Matthew-G.-Kirschenbaum/e/B001IXMCAY/
2
1. Assignments
In-Class Participation, Exercises, and Discussion Board Postings
Class participation is vital to your learning experience. All students are expected to come to class
having completed the readings for the week, and to contribute meaningfully to class discussion. To
support class discussion, students are required to post two questions or points prompted by each
week’s readings on the NYU Classes discussion board. Postings must be submitted each week at
least two hours prior to the beginning of class (earlier posting is strongly encouraged). We will work
through a number of activities and exercises as a group in class throughout the semester, designed to
help you understand the ideas and tools presented in the readings. You must attend and participate in
class order to benefit from these activities; participation will be evaluated on quality, not quantity.
Conceptual Models Reaction Paper
Due Week 3 (09/17): Write a 4-6 page paper that identifies major features or components of the
OAIS Reference Model and DCC Life Cycle model. Discuss how the two models overlap and/or
complement each other and their relative values to an institution that collects digital archives.
Preservation Policy Comparison
Due Week 5 (10/1): Write a 4-6 page paper comparing the digital preservation policies of two
libraries or archives. Identify the main sections of each, analyze their strengths and weaknesses and
put forth an argument as to which is the more comprehensive and/or effective plan. (For a list of
plans, see: http://blogs.loc.gov/digitalpreservation/2013/08/analysis-of-current-digital-preservationpolicies-archives-libraries-and-museums/.
Additional plans may be found via Internet search.
File Format Report
Due Week 7 (10/15): Write a 2-4 page paper exploring a sustainable or preservation-quality file
format. Select a file format identified by the Florida Digital Archive as being in the ‘high’ or ‘medium’
confidence level (see http://fclaweb.fcla.edu/uploads/recFormats.pdf). Detail the format’s background
and development (including if it is open source or proprietary), the extent of its use, and those features
or affordances that make it more likely to remain functional/accessible over the long term. Identify if
the format is a preservation format for other file formats in the Archivematica FPR
(http://sandbox.archivematica.org/fpr/format/ login with demo@example.com/demodemo)
Repository Software Report and Presentation
Due Week 10 (11/5): Write a 4-5 page paper on a repository software platform and then share your
findings with the class in a 5 minute presentation. Choose from one of the following platforms:
●
●
●
●
●
DSpace (http://www.dspace.org/)
Fedora/Hydra (http://www.fedora-commons.org/ http://projecthydra.org/)
Fedora/Islandora (http://www.fedora-commons.org/ http://islandora.ca/)
DuraCLoud (http://www.duracloud.org/)
Archivematica / Archives Direct (https://www.archivematica.org/en/
http://archivesdirect.org/overview)
3
●
●
Preservica (http://preservica.com/)
Rosetta (http://www.exlibrisgroup.com/category/RosettaOverview)
Respond to the following for the chosen repository in a 4-5 page paper:
●
●
●
●
●
What is the background/development history of the platform?
What hardware/software dependencies are required to implement this solution?
What are the platform’s significant features and functionality?
How widely-used is this platform? Who are its primary users?
Would you recommend this as a long-term repository solution? Why or why not?
Final Project
Due Week 14 (12/10): You will apply your understanding of Audit and Certification of Trustworthy
Digital Repositories (ISO 16363:2012) to evaluate the policies and procedures of an actual digital
repository. The project deliverables will include a 6-8 page report, 1-2 pages of interview questions,
and a 10 minute in-class presentation on your findings.
Select one of the following repositories (or get instructor approval for an alternate, making sure that it
has a high level of transparency regarding its operations):
●
●
●
●
●
●
●
●
●
●
●
UK Data Archive (http://www.data-archive.ac.uk/)
Florida Digital Archive: http://fclaweb.fcla.edu/FDA
HathiTrust: http://www.hathitrust.org/about
Portico: http://www.portico.org/digital-preservation/
DPN (Digital Preservation Network): http://www.dpn.org/ and
https://wiki.duraspace.org/display/DPNC/Digital+Preservation+Network
British Library: http://www.bl.uk/aboutus/
LOCKSS: http://www.lockss.org/
California Digital Library (Merritt): http://www.cdlib.org/
ICPSR: http://www.icpsr.umich.edu/icpsrweb/content/datamanagement/index.html
ARTstor: http://www.artstor.org/
JSTOR: http://about.jstor.org/about
Review the available documentation for the repository (you may have to look in various locations on
the website of the repository and/or its parent organization) and produce a 6-8 page report on the
repository’s compliance with one of the following sections from TRAC:
3. Organizational Infrastructure
3.1 Governance and Organizational Viability
3.2 Organizational Structure and Staffing
3.3 Procedural Accountability and Preservation Policy Framework
3.4 Financial Sustainability
3.5 Contracts, Licenses, and Liabilities
4. Digital Object Management
4.1 Ingest: Acquisition of Content
4.2 Ingest: Creation of the AIP
4.3 Preservation Planning
4.4 AIP Preservation
4.5 Information Management
4
4.6 Access Management
5. Infrastructure and Security Risk Management
5.1 Technical Infrastructure Risk Management
5.2 Security Risk Management
For the chosen section, define the requirements as set forth in the Audit and Certification of
Trustworthy Digital Repositories document and then either (a) explain how the repository fulfills the
requirements, citing and quoting from applicable policies and documentation or (b) note how the
repository fails to meet the requirement and make recommendations for it to become compliant.
Finally, identify 3-4 roles within the organization that you would like to interview for more information.
List the questions (1-2 pages) you would like to ask a person in each role to supplement your audit
report.
For the presentation, provide the class with background information on the repository and then give an
overview of its compliance with Audit and Certification of Trustworthy Digital Repositories, noting
particular strengths and weaknesses. Include any recommendations your group would make to
repository administrators and deliver a conclusion on the level or extent of its compliance.
5
Weekly Schedule
Week 1: Introduction and Overview
Required Readings:
● Bearman, David. “The Implications of Armstrong V. Executive Office of the President for the
Archival Management of Electronic Records” The American Archivist (Vol. 56, 1993)
http://www.jstor.org/stable/40293774?seq=1#page_scan_tab_contents
● Kirschenbaum, Matthew. “Mechanisms”, chapter 1. MIT Press (2008)
https://drive.google.com/file/d/0BzwfMxRj-znmS0FuYUYxdERyS2M/view?usp=sharing
● Lee, Christopher A. and Tibbo, Helen. “Where’s the Archivist in Digital Curation? Exploring the
Possibilities through a Matrix of Knowledge and Skills.” Archivaria: 72 (Fall 2011) pp. 123-168.
http://www.ils.unc.edu/callee/p123-lee.pdf
● McGovern, Nancy B. and Kenney, Anne R. “Digital Preservation Management: Implementing
Short-term Strategies for Long-term Problems” Online Tutorial (2012)
http://www.dpworkshop.org/dpm-eng/eng_index.html
● Owens, Trevor. “What Do you Mean by Archive? Genres of Usage for Digital Preservers.” The
Signal Blog (2014) http://blogs.loc.gov/digitalpreservation/2014/02/what-do-you-mean-byarchive-genres-of-usage-for-digital-preservers/
Videos:
● Library of Congress. “Why Digital Preservation is Important for Everyone.” (2010)
http://www.youtube.com/watch?v=qEmmeFFafUs
● Digital Preservation Europe. “Digital Preservation and Nuclear Disaster: An Animation.” (2009)
http://www.youtube.com/watch?v=pbBa6Oam7-w
Recommended Readings:
● Lazorchak, Butch. “Digital Preservation, Digital Curation, Digital Stewardship: What’s in (Some)
Names?” The Signal: Digital Preservation Blog (August 23, 2011)
http://blogs.loc.gov/digitalpreservation/2011/08/digital-preservation-digital-curation-digitalstewardship-what%E2%80%99s-in-some-names/
● Walters, Tyler and Katherine Skinner. New Roles for New Times: Digital Curation for
Preservation. Washington, DC: Association of Research Libraries, March 2011.
http://www.arl.org/storage/documents/publications/nrnt_digital_curation17mar11.pdf
6
Week 2: Conceptual Models—OAIS and DCC Curation Lifecycle Models
Due: Conceptual Model Reaction Paper (4-5 pages)
Guest Lecturer: Sally Vermaaten on Curation of Research Data
Class Objectives:
● Examine the Reference Model for an Open Archival Information System (OAIS) and its status
as a foundational text for much of the current theory and practice related to digital curation.
● Identify roles and responsibilities of major stakeholders in the OAIS Reference model.
● Define and characterize the six functional entities of the OAIS Reference model.
● Articulate the nature and components of an ‘information package’ and distinguish between
Submission, Archival, and Dissemination Information Packages.
● Discuss the possibilities of implementing the OAIS reference model as well as its inherent
limitations.
● Explore the Digital Curation Centre’s (DCC) Curation Life Cycle Model as an alternative or
supplemental conceptual model to the OAIS Reference Model.
Required Readings:
● CCSDS 650.0-M-2: Reference Model for an Open Archival Information System (OAIS).
Magenta Book. June 2012. http://public.ccsds.org/publications/archive/650x0m2.pdf. (scan
this, we will be working with OAIS throughout the semester.)
● McDonough, Jerome P. “‘Knee-Deep in the Data’: Practical Problems in Applying the OAIS
Reference Model to the Preservation of Computer Games.” Proceedings of the 45th Hawaii
International Conference on System Sciences (2012).
https://www.computer.org/csdl/proceedings/hicss/2012/4525/00/4525b625.pdf
● Vardigan, Mary and Whiteman, Cole. “ICPSR Meets OAIS: Applying the OAIS Reference
Model to the Social Science Archive Context.” Archival Science: 7:1 (August 2007) p. 73-87.
http://hdl.handle.net/2027.42/60440
● Digital Curation Lifecycle Model: http://www.dcc.ac.uk/docs/publications/DCCLifecycle.pdf
● Thomas, Susan. “Introduction to OAIS” PARADIGM Workbook on Digital Private Papers
(2008) http://www.paradigm.ac.uk/workbook/introduction/oais.html.
● Higgins, Sarah. “The DCC Curation Lifecycle Model.” International Journal of Digital Curation,
Vol 3, No 1 (2008). http://www.ijdc.net/index.php/ijdc/article/viewFile/69/48.
Week 3: Organizational Infrastructure and Policy Development
Class Objectives:
● Define the roles and responsibilities of organizations in digital curation activities.
● Identify needs and appropriate strategies to staff a digital curation program.
● Articulate essential skills required by archivists and others engaged in digital curation.
● Highlight the centrality of realistic and well-documented policy to digital curation activities.
● Articulate key components of digital preservation/curation policies.
Required Readings:
● Beagrie, Neil, Semple, Najla, et al. Digital Preservation Policies Study: Part 1 (2008)
http://www.jisc.ac.uk/media/documents/programmes/preservation/jiscpolicy_p1finalreport.pdf
● Kirschenbaum, Matthew. “Mechanisms”, chapter 2. MIT Press (2008)
7
●
McGovern, Nancy and Kenney, Anne. “The Five Organizational Stages of Digital
Preservation.” Digital Libraries: A Vision for the 21st Century: A Festschrift in Honor of Wendy
Lougee on the Occasion of her Departure from the University of Michigan. MPublishing: Ann
Arbor, 2003.
http://quod.lib.umich.edu/s/spobooks/bbv9812.0001.001/1:11?rgn=div1;view=fulltext
● National Digital Stewardship Alliance Standards and Practices Working Group. “Staffing for
Effective Digital Preservation: An NDSA Report.” (2013)
http://digitalpreservation.gov/ndsa/documents/NDSA-Staffing-Survey-Report-Final122013.pdf
● Prom, Chris. “Develop Program Statement” (2009) http://erecords.chrisprom.com/recommendations/electronic-records-program-statement-template/
● Example Policies (browse):
● ICPSR Digital Preservation Framework
http://www.icpsr.umich.edu/icpsrweb/content/datamanagement/preservation/policies/dp
p-framework.html
● Ohio State University Libraries Digital Preservation Framework (2013)
http://library.osu.edu/documents/SDIWG/Digital_Preservation_Policy_Framework.pdf
● Old Dominion University Libraries Digital Preservation Policy (2012)
http://www.lib.odu.edu/aboutthelibraries/ODULibrariesDigitalPreservationPolicy.pdf
Video:
● O’Meara, Erin. “No One Cooks the Bacon Alone: Models for Success in Building out a DigitallyIntegrated Special Collections Program.” OCLC Past Forward! Meeting(Jine 4, 2013)
http://www.youtube.com/watch?v=xnQ5G1fH5-8
Recommended Readings:
● Prom, Chris. “Policy Development Templates” (2011) http://erecords.chrisprom.com/resources/policy-templates/
● Sheldon, Madeline. “Analysis of Current Digital Preservation Policies: Archives, Libraries, and
Museums.” (2013)
http://www.digitalpreservation.gov/documents/Analysis%20of%20Current%20Digital%20Preser
vation%20Policies.pdf
Week 4: Data Creation and Pre-Ingest Activities
Due: Preservation Policy Comparison (4-6 pages)
Class Objectives:
● Articulate the importance of proactive archival involvement in digital environments
● Compare the traditional ‘records lifecycle model’ with the Australian ‘records continuum’ in
which archivists engage with record creators at or before record creation to advise on:
● File formats (analyze important characteristics and features of formats)
● Recordkeeping practices (identify best practices for file naming and directory
structures)
● Identify important considerations in working with donors and building trust.
● Define issues and strategies for conducting record surveys and appraising digital archives.
Required Readings:
● McKemmish, Sue. “Yesterday, Today and Tomorrow: A Continuum of Responsibility”
Proceedings of the Records Management Association of Australia 14th National Convention
8
●
●
●
●
(1997)
http://www.infotech.monash.edu.au/research/groups/rcrg/publications/recordscontinuumsmckp2.html
NDIIP. “Formats, Evaluation Factors, and Relationships.” Sustainability of Digital Formats:
Planning for Library of Congress Collections (2013)
http://www.digitalpreservation.gov/formats/intro/format_eval_rel.shtml
AIMS (An Inter-Institutional Model for Stewardship ) Working Group. “1. Collection
Development” AIMS Born-Digital Collections White Paper. (2012) pp. 4-16
http://www.digitalcurationservices.org/aims/white-paper
AIMS Digital Material Survey (2010) https://docs.google.com/document/edit?id=1zhAUIAOyvBmGvmi-jHeQZOLbsObNxt5j8SOZPQAYEo&hl=en&authkey=CKnE4ogP
Whyte, A. & Wilson, A. (2010). "How to Appraise and Select Research Data for Curation". DCC
How-to Guides. Edinburgh: Digital Curation Centre. http://www.dcc.ac.uk/resources/howguides/appraise-select-data
Recommended Reading:
● ICPSR “Details on Appraisal Criteria”
http://www.icpsr.umich.edu/icpsrweb/content/datamanagement/lifecycle/details.html
● Personal Archives Accessible in Digital Media (PARADIGM). Workbook on Private Digital
Papers (2008) Universities of Oxford and Manchester (U.K.)
● “The nature of personal digital archives” (sub-section)
http://www.paradigm.ac.uk/workbook/record-creators/nature.html
● “Appraisal and disposal” http://www.paradigm.ac.uk/workbook/appraisal/index.html
● PARADIGM records survey http://www.paradigm.ac.uk/workbook/appendices/recordssurvey.html
● State Archives of North Carolina. “Best Practices for File-Naming” (2008)
http://www.ncdcr.gov/Portals/26/PDF/guidelines/filenaming.pdf
● BARTS and the London NHS Trust. “How to Manage and Organise Shared Drives.” (2007)
http://www.healtharchives.org/docs/BLT_How_to_Manage_and_Organise_Shared_Drives.pdf
Week 5: Transfer and Ingest of Digital Content
Class Objectives:
● Identify important issues, considerations, and strategies related to the transfer of digital content
to archival custody.
● Discuss important components and models for transfer agreements and/or deeds of gift for
digital archives.
● Define functional requirements for ingest, in light of PAIMAS and OAIS.
● Explore workflows and tools for the successful transfer and ingest of digital archives
In-Class Tool Demonstration/Exploration: Tools for Transfer and Ingest (with test data or local
files)
● DROID (UK National Archives)
○ http://www.nationalarchives.gov.uk/information-management/projects-andwork/droid.htm
● Bagger (Library of Congress)
○ http://sourceforge.net/projects/loc-xferutils/files/loc-bagger/
9
Required Readings:
● Kirschenbaum, Matthew. “Mechanisms”, chapter 3. MIT Press (2008)
● Consultative Committee for Space Data Systems. Producer-Archive Interface Methodology
Abstract Standard (PAIMAS). CCSDS 651.0-M-1. Washington, D.C.: May 2004.
http://public.ccsds.org/publications/archive/651x0m1.pdf
● AIMS (An Inter-Institutional Model for Stewardship )Working Group. (2012). AIMS Born-Digital
Collections White Paper. http://www.digitalcurationservices.org/aims/white-paper
○ “2. Accessioning” pp. 17-30
● Goldman, Ben. “Using What Works: A Practical Approach to Accessioning Born-Digital
Archives.” http://e-records.chrisprom.com/guest-post-ben-goldman/
● MIT Institute Archives and Special Collections
○ “Digital Archives Transfer and Ingest workflow Guide” (December 20, 2012)
http://libraries.mit.edu/digital-archives/files/2013/03/Digital-Archives-WorkflowDraft03.pdf
○ “Visualizing PAIMAS and OAIS” (August 21, 2013) http://libraries.mit.edu/digitalarchives/visualizing-paimas-and-oais/
Recommended Readings:
● Personal Archives Accessible in Digital Media (PARADIGM). “Accessioning digital and hybrid
personal archives” Workbook on Private Digital Papers (2008) Universities of Oxford and
Manchester (U.K.) http://www.paradigm.ac.uk/workbook/record-creators/accessioning.html
● Tufts Accessioning Program for Electronic Records (TAPER) 2011
http://sites.tufts.edu/dca/about-us/research-initiatives/taper-tufts-accessioning-program-forelectronic-records/
● Redwine, Gabriela, et al. “Born Digital: Guidance for Donors, Dealers, and Archival
Repositories.” Council on Library and Information Resources Publication 159 (2013)
http://www.clir.org/pubs/reports/pub159/pub159.pdf
● De Jong, Annemieke, Beth Delaney and Daniel Steinmeier. “OAIS Compliant Preservation
Workflows in an AV Archive” (September 5, 2013)
https://www.prestocentre.org/system/files/library/resource/oais_compliant_preservation_workfl
ows_in_an_av_archive_pdf0.pdf
● University of Illinois at Urbana-Champaign University Archives
○ “Digital Accession and Processing Workflow”
http://archives.library.illinois.edu/staff/digital/
○ “Digital Checklist”
http://archives.library.illinois.edu/staff/documents/digital/digitalchecklist.docx
● Preserving (Digital) Objects With Restricted Resources (POWRR). “Tool Grid” (2012)
http://digitalpowrr.niu.edu/tool-grid/
Week 6: Community Resources and Standards for the Ingest of Digital Content
Due: File Format Report (2-3 pages)
Class Objectives:
● Understand the nature and development strategies of open source software projects.
● Consider factors in selecting open-source projects for implementation.
● Analyze functionality and features of Archivematica and BitCurator, two of the leading opensource software projects related to the ingest of digital archives.
● Identify the importance of the ‘digital forensics’ techniques employed by the BitCurator project
as well as potential issues with privacy and deleted data.
10
●
●
Discuss requirements and challenges of implementing Archivematica and/or BitCurator.
Explore and evaluate Archivematica and BitCurator in class.
In Class Demonstration/Exploration:
Archivematica (TBD)
Archivematica sandbox is located at:
http://sandbox.archivematica.org/administration/accounts/login/
login with demo@example.com/demodemo
Bitcurator (TBD)
Required Readings:
 Kirschenbaum, Matthew. “Mechanisms”, chapter 4. MIT Press (2008)
Open-Source Software Evaluation:
● Craven, Tim. “Software Evaluation Criteria” (2003)
http://publish.uwo.ca/~craven/505/505swe.htm
● Wheeler, David. “How to Evaluate Open Source Software / Free Software (OSS/FS)
Programs” (2011) http://www.dwheeler.com/oss_fs_eval.html
Archivematica:
● Owens, Trevor. “Archivematica and the Open Source Mindset for Digital Preservation
Systems.” The Signal (October 16, 2012)
http://blogs.loc.gov/digitalpreservation/2012/10/archivematica-and-the-open-source-mindsetfor-digital-preservation-systems/
● Van Garderen, Peter. “Archivematica: Using Micro-Services and Open-Source Software to
Deliver a Comprehensive Digital Curation Solution.” iPRES Conference Paper (2010)
http://www.ipres-conference.org/ipres10/papers/vanGarderen28.pdf
● Archivematica Wiki (2014) https://www.archivematica.org/wiki/Main_Page. Browse, including:
● Overview https://www.archivematica.org/wiki/Overview
● Format Policies https://www.archivematica.org/wiki/Media_type_preservation_plans
Digital Forensics/BitCurator:
● Knight, Gareth. (2012) “The Forensic Curator: Digital Forensics as a Solution to Addressing the
Curatorial Challenges Posed by Personal Digital Archives.” The International Journal of Digital
Curation (7:2) http://www.ijdc.net/index.php/ijdc/article/view/218
● Lee, C.A., Kirschenbaum, M., Chassanoff, A., Olsen, P., & Woods, K. (2012). “BitCurator:
Tools and techniques for digital forensics in collecting institutions.” D-Lib Magazine (18: 5/6)
http://dlib.org/dlib/may12/lee/05lee.html
● Olsen, P., Chassanoff, A. (2013). “The BitCurator environment: Using digital forensics tools for
born-digital curation.” Poster presented at the 2013 Personal Digital Archiving Conference.
http://ils.unc.edu/~achass/publications/pda2013_v6.pdf
Video:
● Artefactual Systems. “Archivematica 1.0 Screencast” (2014)
https://www.youtube.com/watch?v=dm6AnHItlo8
● Olsen, Porter. “Bringing Digital Forensics to the Library.” (2013)
https://www.youtube.com/watch?v=bAYlpZPMn_I
Recommended Readings:
● BitCurator Project Documentation:
● Main site (news, blog, forum, etc.): http://www.bitcurator.net/
● Wiki (user manual, screencasts, descriptions of tools, and downloads):
http://wiki.bitcurator.net/index.php?title=Main_Page
11
●
●
Lee, Christopher A. et al. “From Bitstreams to Heritage: Putting Digital Forensics into Practice
in Collecting Institutions” (2013) http://www.bitcurator.net/docs/bitstreams-to-heritage.pdf
Kirschenbaum, Matthew, et al. “Digital Forensics and Born-Digital Content in Cultural Heritage
Collections.” Council on Library and Information Resources Publication 149 (2010)
http://www.clir.org/pubs/reports/pub149/reports/pub149/pub149.pdf
Week 7: Metadata and Descriptive Standards
Class Objectives:
● Review “Preservation Description Information” as a component of Information Packages in the
OAIS Reference Model
● Review major metadata schema used in digital archives, general (METS, MODS, PREMIS,
Dublin Core, etc.) and format/media specific
● Examine use and best practices of widely used schema (including embedding metadata in file
headers)
● Introduce linked data and explore how it can be implemented/made useful for archives
In-Class Demonstration/Exploration: BWF MetaEdit (requires WAV audio files)
● Download and user manual: http://bwfmetaedit.sourceforge.net/
● Tutorial: https://tutorials.ischool.utexas.edu/index.php?title=BWF_MetaEdit
● Guidelines: Embedded Metadata in Broadcast WAVE Files:
http://www.digitizationguidelines.gov/guidelines/digitize-embedding.html
Required Readings:
● Dappert, Angela and Markus Enders. (2010) “Digital Preservation Metadata Standards.”
Information Standards Quarterly (22:2)
http://www.loc.gov/standards/premis/FE_Dappert_Enders_MetadataStds_isqv22no2.pdf
● Tufts University and IMLS: LiAM: Linked Archival Metadata
● “What is Linked Data and why should I care?”
http://sites.tufts.edu/liam/2013/09/03/what-is-ld/
● “Publishing linked data by way of EAD files”
http://sites.tufts.edu/liam/2014/01/05/linked-data-via-ead/
● Library of Congress. METS Primer (2010)
http://www.loc.gov/standards/mets/METSPrimerRevised.pdf
● Chapter 1: Introduction and Background (pp. 15-17)
● Chapter 2: Authoring a METS Document (pp. 18-24)
● Personal Archives Accessible in Digital Media (PARADIGM). “Administrative and Preservation
Metadata” Workbook on Private Digital Papers (2008) Universities of Oxford and Manchester
(U.K.) http://www.paradigm.ac.uk/workbook/metadata/index.html
● Priscilla Caplan, Understanding PREMIS, Library of Congress, 2009.
http://www.loc.gov/standards/premis/understanding-premis.pdf
Video:
● Europeana. “Linked Open Data - What is it?” (2012)
http://www.youtube.com/watch?v=uju4wT9uBIA
● Berners-Lee, Tim. “The Next Web” TED (2009)
http://www.ted.com/talks/tim_berners_lee_on_the_next_web.html
Recommended Readings:
● Harvard University Information Technology Librarian Information Technology. “Metadata
Standards.” (2008) http://hul.harvard.edu/ois/digproj/metadata-standards.html
12
●
●
Dappert, Angela and Markus Enders, “Using METS, PREMIS and MODS for Archiving
eJournals,” D-Lib Magazine 14/9/10 (September/October 2008)
http://www.dlib.org/dlib/september08/dappert/09dappert.html
McManus, Richard. “Linked Data is Blooming: Why You Should Care” ReadWrite (May 17,
2009)
http://readwrite.com/2009/05/17/linked_data_is_blooming_why_you_should_care#awesm=~ox
rFor1rWbfGWb
Week 8: Preservation Planning
Class Objectives:
● Define authenticity and integrity as they pertain to digital archives.
● Articulate the “significant characteristics” of common file formats and media types that must be
preserved for content to remain useful and retain its authenticity.
● Identify major strategies and resources that will facilitate the long-term preservation and use of
digital archives.
● Evaluate the practicality and cost-effectiveness of implementing migration and/or emulation as
preservation strategies.
● Explore the NDSA Levels of Preservation as guidelines for planning activities
● Examine how preservation planning fits into overall activities and workflows, per the OAIS
Reference Model.
In-Class Tool Demonstration/Exploration: Checksum Calculation and Verification
● Mac: native ‘md5’ command in Terminal (see http://osxdaily.com/2009/10/13/check-md5-hashon-your-mac/)
● Windows: MD5 Summer (http://www.md5summer.org/; for instructions see
http://www.md5summer.org/help.html)
Required Readings:
● Florida Center for Library Automation/Florida Digital Archives
● FDA Preservation Support Levels: http://fclaweb.fcla.edu/node/897
● FDA-Supported File Formats (browse background reports and action plans):
http://fclaweb.fcla.edu/node/795
● Grace, Stephen, Gareth Knight and Lynne Montague. “InSPECT: Investigating the Significant
Properties of Electronic Content over Time” Project Final Report (2009)
http://www.significantproperties.org.uk/inspect-finalreport.pdf
● Library of Congress. “National Digital Stewardship Alliance (NDSA) Levels of Preservation.”
(2012) http://www.digitalpreservation.gov/ndsa/activities/levels.html
● Lynch, Clifford. “Authenticity and Integrity in the Digital Environment: An Exploratory Analysis
of the Central Role of Trust.” Authenticity in a Digital Age (Washington: CLIR, 2000): 32-50
http://www.clir.org/pubs/reports/pub92/lynch.html
● Personal Archives Accessible in Digital Media (PARADIGM). “Digital Preservation Strategies”
Workbook on Private Digital Papers (2008) Universities of Oxford and Manchester (U.K.)
http://www.paradigm.ac.uk/workbook/preservation-strategies/index.html
● Rosenthal, D. (2010). “Format Obsolescence: Assessing the Threat and the Defenses.” Library
Hi-Tech, 28(2), 195-210. http://lockss.org/locksswiki/files/LibraryHighTech2010.pdf
Video:
● Digital Preservation Europe. “Preserving the British Library’s 19th Century Newspaper
Collection with PLANETS.” (2010) http://www.youtube.com/watch?v=K6NnFcSpAh8
Recommended Readings:
13
●
●
●
●
Blanchette, Jean-Francois. (2011) “A Material History of Bits.” Journal of the American Society
for Information Science and Technology.
http://polaris.gseis.ucla.edu/blanchette/papers/materiality.pdf
Integrity and Authenticity of Digital Cultural Heritage Objects. Digicult Thematic Issue #1, 2002.
http://www.digicult.info/downloads/thematic_issue_1_final.pdf
McLellan, Evelyn. (2010) “Selecting formats for Digital Preservation: Lessons Learned during
the Archivematica Project.” Information Standards Quarterly (22:2)
http://www.niso.org/apps/group_public/download.php/4237/IP_McLellan_Selecting_Formats_is
qv22no2.pdf
Strodl, Stephan, et al. “How to Choose a Digital Preservation Strategy: Evaluating a
Preservation Planning Procedure.” Proceedings of the ACM IEEE Joint Conference on Digital
Libraries. (June 18-23, 2007) http://www.ifs.tuwien.ac.at/~strodl/paper/FP060-strodl.pdf
Week 9: Storage and Repositories
Due: Repository Software Report and Presentation (4-5 pages; 5 minutes)
Class Objectives:
● Define requirements and selection criteria for the implementation of sustainable storage
infrastructure.
● Explore options for storage (including the cloud) and repository software (both open-source
and proprietary).
● Identify important policies and relevant staff skills related to the management of repositories
and/or storage infrastructure.
● Discuss relevant issues and strategies for successful collaboration and communication
between archivists and IT.
● Highlight important preservation actions associated with archival storage, including replication
(backups), regular refreshment/replacement of hardware, and periodic integrity checks/audits.
Required Readings:
Kirschenbaum, Matthew. “Mechanisms”, chapter 5. MIT Press (2008)
General Issues, Characteristics, and Considerations:
● NDIIPP. “How Long Will Digital Storage Media Last” 2011
http://digitalpreservation.gov/personalarchiving/documents/media_durability.pdf
● Brown, Adrian. “Digital Preservation Guidance Note 2: Selecting Storage Media for Long-Term
Preservation” UK National Archives: 2008.
http://www.nationalarchives.gov.uk/documents/selecting-storage-media.pdf
● Altman, Micah; Bailey, Jefferson; Cariani, Karen; Gallinger, Michelle; Owens, Trevor (2013).
“NDSA Storage Report: Reflections on National Digital Stewardship Alliance Member
Approaches to Preservation Storage Technologies” D-Lib (19:5/6)
http://www.dlib.org/dlib/may13/altman/05altman.html
Cloud Storage:
● Instrumental, Inc. (2013) Report on Digital Preservation and Cloud Services (prepared for
Minnesota Historical Society).
http://www.mnhs.org/preserve/records/docs_pdfs/Instrumental_MHSReportFinal_Public_v2.pdf
● Rosenthal, David. “Cloud Services: Caveat Emptor” DSHR’s Blog (September 24, 2013)
http://blog.dshr.org/2013/09/panel-at-library-of-congress-storage.html
● Reilly, Bernard. “Planning for Digital Preservation: 20 Questions for Providers of Digital
Storage Services” (2007)
14
http://www.nedcc.org/assets/media/documents/QuestionstoAskProvidersofDigitalStoragefinal.p
df
Repository Options and Considerations:
● Repositories Support Project
● Repository Software Survey (November 2010) http://www.rsp.ac.uk/start/softwaresurvey/results-2010/
● Specifying Repository Requirements (November 2011)
http://www.rsp.ac.uk/documents/briefingpapers/2011/Specifying%20Repository%20Requirements_RSP_1111.pdf
● Micah Altman, Margaret O. Adams, Jonathan Crabtree, Darrell Donakowski, Marc Maynard,
Amy Pienta, and Copeland H. Young. “Digital Preservation through Archival Collaboration: The
Data Preservation Alliance for the Social Sciences,” American Archivist 72, no. 1 (2009): 170184. http://thedata.org/files/thedata_new2/files/sharedpractices.pdf (pre-print)
Recommended Reading
● Reich, Vicky and David S.H. Rosenthal (2001). “LOCKSS: A Permanent Web Publishing and
Access System” D-Lib (7:6). http://www.dlib.org/dlib/june01/reich/06reich.html
● Hitchcock, Steve, et al., "Toward Smart Storage for Repository Preservation Services," The
International Journal of Digital Curation (1:5) 2010:
http://www.ijdc.net/index.php/ijdc/article/viewFile/156/219
● Wright, Richard, Ant Miller, and Matthew Addis. "The Significance of Storage in the 'Cost of
Risk' of Digital Preservation." International Journal of Digital Curation 4/3 (2009).
http://www.ijdc.net/index.php/ijdc/article/view/138
● Repositories Support Project
● Repository Policy Framework (August 2011) http://www.rsp.ac.uk/documents/briefingpapers/2011/RepositoryPolicyFramework_RSP_0811.pdf
● Institutional Repositories: Staff and Skills Set (October 2011)
http://www.rsp.ac.uk/documents/Repository_Staff_and_Skills_Set_2011.pdf
● Personal Archives Accessible in Digital Media (PARADIGM). “Digital Repositories” Workbook
on Private Digital Papers (2008) Universities of Oxford and Manchester (U.K.)
http://www.paradigm.ac.uk/workbook/repository/index.html
Week 10: Intellectual Property Rights, Costs, and Long-Term Sustainability
Class Objectives:
● Identify major issues and considerations related to copyright and intellectual property rights in
digital archives.
● Understand immediate and long-term costs associated with digital curation.
● Examine strategies and considerations for developing and maintaining a sustainable digital
archives program.
● Articulate essential components of digital disaster recovery plans and explore aspects of the
planning process.
Required Readings:
Intellectual Property Rights and Issues:
● Gasaway, Laura N. and Richard S. Rudick, co-chairs. The Section 108 Study Group Final
Report (2008). http://www.section108.gov/docs/Sec108StudyGroupReport.pdf (Focus on
Executive Summary and Sections I, II, and IV.A.2)
● Hirtle, Peter B. “Digital Preservation and Copyright.” Copyright and Fair Use: Stanford
University Libraries (2003).
http://fairuse.stanford.edu/2003/11/10/digital_preservation_and_copyr/
15
Costs:
● Kejser, Ulla Bøgvad and Nielsen, Anders Bo and Thirifays, Alex. “Cost Model for Digital
Preservation: Cost of Digital Migration.” The International Journal of Digital Curation (1:6)
2011. 255-267 http://www.ijdc.net/index.php/ijdc/article/viewFile/177/246
● Wheatley, Paul and Ayris, Paul and Davies, Richard and McLeod, Rory and Shenton, Helen
(2007) LIFE: Costing the digital preservation lifecycle. Presented at: iPRES Annual Conference
2007, Beijing, China. http://discovery.ucl.ac.uk/4914/1/4914.pdf
Sustainability:
● JISC Digital Media “A Guide to Sustainability” (2013) http://www.jiscdigitalmedia.ac.uk/guide/aguide-to-sustainability
● Blue Ribbon Task Force on Sustainable Digital Preservation and Access. Sustainable
Economics for a Digital Planet: Ensuring Long-Term Access to Digital Information. (2010)
http://brtf.sdsc.edu/biblio/BRTF_Final_Report.pdf
Disaster Planning:
● Paul V. Glavin Library, Illinois Institute of Technology. “Digital Disaster Recovery Plan” (2012)
http://library.iit.edu/disaster-plan/DigitalEmergencyPlan-current.pdf
● Frank, Rebecca D. and Beth Yakel (2013) “Disaster Planning for Digital Repositories.”
Proceedings of the 76th Annual Meeting of the. Association for Information Science and
Technology. http://www.asis.org/asist2013/proceedings/submissions/papers/59paper.pdf
Recommended Readings:
● Association of Research Libraries. Code of Best Practices in Fair Use for Academic and
Research Libraries (2012) http://www.arl.org/focus-areas/copyright-ip/fair-use/code-of-bestpractices
● Fisher, William W. and William McGeveran. The Digital Learning Challenge: Obstacles to
Educational Uses of Copyrighted Material in the Digital Age (2006)
http://cyber.law.harvard.edu/sites/cyber.law.harvard.edu/files/BerkmanWhitePaper_08-102006.pdf
● Library of Congress et al. International Study on the Impact of Copyright Law on Digital
Preservation (2008).
http://www.digitalpreservation.gov/library/resources/pubs/docs/digital_preservation_final_report
2008.pdf (Focus on Sections 1, 5, and 6)
● Rosenthal, D. S., Rosenthal, D. C., Miller, E. L., Adams, I. F., Storer, M. W., & Zadok, E. The
Economics of Long-Term Digital Storage. Presented at UNESCO's conference 2012, “Memory
of the World in the Digital Age.” http://www.lockss.org/locksswp/wpcontent/uploads/2012/09/unesco2012.pdf
● Abrams, Stephen, Cruse, Patrica, Kunze, John and Mundrane, Michael. “Total Cost of
Preservation (TCP): Cost Modeling for Sustainable Services” (Rev. 0.16) April 2012.
https://wiki.ucop.edu/download/attachments/163610649/TCP-total-cost-of-preservation.pdf
● Interuniversity Consortium for Political and Social Research (ICPSR):
● Disaster Planning Policy Framework (2009)
http://www.icpsr.umich.edu/files/datamanagement/disaster/dppf.pdf
● Disaster Planning Resources
http://www.icpsr.umich.edu/files/datamanagement/disaster/dp_refs.pdf
● Browse plans and blog posts on disaster planning process at
https://www.icpsr.umich.edu/content/datamanagement/disaster/ or
http://www.researchconnections.org/content/datamanagement/disaster/
● United States Government. “IT Disaster Recovery Plan” (2012)
http://www.ready.gov/business/implementation/IT
16
Week 11: Repository Audit and Certification
Class Objectives:
● Define characteristics of a “trustworthy” digital repository
● Identify tools and methodologies for assessing risks and performing audits of repositories:
● SPOT
● DRAMBORA
● Audit and Certification of Trustworthy Digital Repositories (now ISO 16363:2012)
● Data Seal of Approval (DSA)
● Explore in-depth the three main sections of Audit and Certification of Trustworthy Digital
Repositories (using the Ontario Council of University Libraries’ Scholars Portal to illustrate, as
needed)
● Introduce final class project
Required Readings:
● Digital Preservation Coalition. “Digital Preservation Risks” DPC Wiki (2013)
http://wiki.dpconline.org/index.php?title=Digital_preservation_risks
● Vermaaten, Sally, Brian Lavoie and Priscilla Caplan (2012) “Identifying Threats to Successful
Digital Preservation: the SPOT Model for Risk Assessment” D-Lib Magazine (18:9/10)
http://www.dlib.org/dlib/september12/vermaaten/09vermaaten.html
● DRAMBORA
● Donnelly, Martin. “Risk and Trust and Data Management” Presentation, KeepIt No. 5,
University of Northampton (UK), 30 March 2010
http://www.slideshare.net/SteveHitchcock/keepit-course-5-drambora-risk-and-trust-anddata-management-by-martin-donnelly
● Main project site (browse): http://www.repositoryaudit.eu/
● Audit and Certification of Trustworthy Digital Repositories:
http://public.ccsds.org/publications/archive/652x0m1.pdf
Recommended Readings:
● Research Libraries Group. Trusted Digital Repositories: Attributes and Responsibilities (2002)
http://www.oclc.org/content/dam/research/activities/trustedrep/repositories.pdf
● Ontario Council of University Libraries (Scholars Portal)
● Digital Preservation Mandate (2013) http://www.ocul.on.ca/node/1639
● Trusted Digital Repository Document Checklist (2012)
https://spotdocs.scholarsportal.info/display/OAIS/Document+Checklist
● ISO16363 Audit Criteria (2012)
https://spotdocs.scholarsportal.info/display/OAIS/ISO16363+Audit+Criteria
Week 12: Access, Use and Outreach
Class Objectives:
● Identify issues and considerations for providing access to digital archives:
● Structure of Dissemination Information Packages (DIPs).
● Policies and restrictions.
● Access mechanisms.
17
●
●
●
Analyze features and functionality of digital archives access portals and their ability to
adequately address broader archival issues of selection, description, and context.
Examine user needs and expectations for digital archives and the growth of ‘digital humanities.’
Explore strategies for outreach and engagement with users.
Required Readings:
● Browse through several of the following to review features and functionality for discussion:
● New York Philharmonic Digital Archives: http://archives.nyphil.org/
● NYPL Digital Collections: http://digitalcollections.nypl.org/
● Archives of American Art Terra Foundation Center for Digital Collections:
http://www.aaa.si.edu/collections/online
● UNC Digital Southern Historical Collections:
http://dc.lib.unc.edu/cdm/archivalhome/collection/ead
● New York State Archives, Library, and Museum Digital Collections:
http://www.archives.nysed.gov/d/
● Pennsylvania State Archives ARIAS (Archives Records Information Access System):
http://www.digitalarchives.state.pa.us/
● Examine several examples of EAD finding aids with links to digital objects (compiled by Ed
Summers, 2014): https://github.com/edsu/eadlinks
● University of California-Irvine Libraries Special Collections and Archives. “Rules of Use for the
Virtual Reading Room in UCIspace @ the Libraries” http://special.lib.uci.edu/using/docs/rulesof-use-virtual-reading-room-ucispace.pdf
● Hedstrom, Margaret, et al. (2006) “‘The Old Version Flickers More’: Digital Preservation from
the User’s Point of View,” American Archivist (69/1): 159-87.
http://archivists.metapress.com/content/1765364485n41800/fulltext.pdf
● Kelly, T. Mills. Teaching History in the Digital Age. Ann Arbor: University of Michigan Press,
2013. http://dx.doi.org/10.3998/dh.12146032.0001.001 (Skim Introduction and Chapters 1-3)
● Szajewski, Michael (2013) “Using Google Analytics Data to Expand Discovery and Use of
Digital Archival Content.” Practical Technology for Archives (1).
http://practicaltechnologyforarchives.org/issue1_szajewski/
● Holley, Rose (2010) “Crowdsourcing: How and Why Should Libraries Do It?” D-Lib Magazine
(16:3/4) http://www.dlib.org/dlib/march10/holley/03holley.html
● J. Gordon Daines III and Cory L. Nimer. “Web 2.0 and Archives.” The Interactive Archivist:
Case Studies in Utilizing Web 2.0 to Improve the Archival Experience (2009)
http://interactivearchivist.archivists.org/
Video:
● Kirschenbaum, Matthew. “Digital Humanities Archive Fever.” Plenary lecture, 2011 Digital
Humanities Summer Institute. http://mkirschenbaum.wordpress.com/2011/08/22/digitalhumanities-archive-fever/
● Arts Council England. “Creative use of digital archives: Expert view” (2011)
http://www.youtube.com/watch?v=EnMQ3zsi3nI
Recommended Readings:
● Rutner, Jennifer and Roger C. Schonfeld. Supporting the Changing Research Practices of
Historians. Ithaka S+R Research (2012) http://www.sr.ithaka.org/researchpublications/supporting-changing-research-practices-historians
● Chowdhury, Gobinda. "From Digital Libraries to Digital Preservation Research: The Importance
of Users and Context." Journal of Documentation 66, no. 2 (2010): 207-223.
● National Archives and Records Administration. “Citizen Archivist Dashboard”
http://www.archives.gov/citizen-archivist/
● Theimer, Kate. "What is the Meaning of Archives 2.0?." American Archivist 74.1 (2011): 58-68.
18
Week 13: Research Data Curation and Management
Class Objectives:
● Identify the needs and requirements for data curation in the science and humanities
communities.
● Analyze the application of archival and digital preservation strategies to the management of
large research data sets.
● Examine how data curation/management requires new partnerships and collaborative
arrangements between researchers, libraries, and archives.
● Explore the evolution and implications of educational and employment opportunities associated
with scientific and humanities research data management.
Required Readings:
● National Science Foundation. “Scientists Seeking NSF Funding Will Soon Be Required to
Submit Data Management Plans” (2010)
http://www.nsf.gov/news/news_summ.jsp?cntn_id=116928
● Conway, E., Giaretta, D., Lambert, S., & Matthews, B. (2011). Curating Scientific Research
Data for the Long Term: A Preservation Analysis Method in Context. International Journal of
Digital Curation (6:2) http://www.ijdc.net/index.php/ijdc/article/view/182
● Jahnke, Lori, Andrew Asher, and Spencer Keralis. The Problem of Data. Council of Library and
Information Resources Publication 154 (2012) http://www.clir.org/pubs/reports/pub154
● UK Data Archive. How We Curate Data (2014)
● “The Process” http://www.data-archive.ac.uk/curate/process
● “Our Preservation Policy” http://www.data-archive.ac.uk/curate/preservation-policy
● “Our Quality Control” http://www.data-archive.ac.uk/curate/archive-quality
Video:
● CLIR. “Sayeed Choudhury (Data Conservancy)” (2012)
http://www.youtube.com/watch?v=oWw7Ifn1Xx8
● Hedstrom, Margaret and Robert MacDonald. “An Overview of the National Science Foundation
DataNet Funded Sustainable Environments-Actionable Data Project” (2011) http://seaddata.net/node/56 or https://www.youtube.com/watch?v=pFVJ4MadmeA
Recommended Readings:
● Akmon, D., Zimmerman, A., Daniels, M., & Hedstrom, M. (2011). “The application of archival
concepts to a data-intensive environment: working with scientists to understand data
management and preservation needs.” Archival Science, 11(3-4), 329-348.
http://deepblue.lib.umich.edu/handle/2027.42/86738 (pre-print version)
● Palmer, Carol L., et al. “Foundations of Data Curation: The Pedagogy and Practice of
‘Purposeful Work’ with Research Data.” Archive Journal (3)
http://www.archivejournal.net/issue/3/archives-remixed/foundations-of-data-curation-thepedagogy-and-practice-of-purposeful-work-with-research-data/
● Choudury, Sayeed (2010) “Data curation: An ecological perspective.” College & Research
Libraries News (71:4) 194-196. http://crln.acrl.org/content/71/4/194.full
● Heidorn, P. B. (2011). “The Emerging Role of Libraries in Data Curation and E-science.”
Journal of Library Administration,51(7-8), 662-672.
19
Week 14: Presentations on TDR Audit and Certification and Course Wrap Up
Due: Final Project (approx. 30 pages; 15 minutes)
Class Objectives:
● Final project group presentations (15 minutes)
● Digital preservation/curation in archives: where have we been and where are we going?
● Wrap up
Required Reading:
● Hirtle, Peter B. “The History and Current State of Digital Preservation in the United States.” In:
Metadata and Digital Collections: A Festschrift in Honor of Thomas P. Turner. Ithaca, NY:
Cornell University, 2010, pp., 121-140.
http://cip.cornell.edu/DPubS/Repository/1.0/Disseminate?view=body&id=pdf_1&handle=cul.pu
b/1238609304.
Video:
● Rothenberg, Jeff. “Digital Preservation in Perspective How Far Have We Come and What's
Next.” (2012) http://www.youtube.com/watch?v=2Idbur1qR8I