On Libraries & Linked Data Antoine Isaac UB Utrecht, April 6, 2011 Who am I? • Europeana • Web & Media Lab, Vrije Universiteit Amsterdam • W3C Library Linked Data group • (2006-2009) W3C Semantic Web Deployment group SKOS aisaac@few.vu.nl Demo Following one’s nose to subject heading lists as linked data • American LCSH http://id.loc.gov/authorities/sh85145447#concept • French RAMEAU http://stitch.cs.vu.nl/vocabularies/rameau/ark:/12148/cb11931913j • German SWD http://d-nb.info/gnd/4064689-0 • Agrovoc http://aims.fao.org/aos/agrovoc/c_8309 • STW http://zbw.eu/stw/descriptor/14188-0 • Further on to DBPedia http://dbpedia.org/resource/Water Demo (fallback option) Subject heading lists as SKOS linked data • American LCSH http://id.loc.gov • French RAMEAU: http://stitch.cs.vu.nl/rameau • German SWD: http://d-nb.info/gnd/ • mapped using manual links from the MACS project http://macs.cenl.org Starting from http://id.loc.gov/authorities/sh85014310#concept Linked Data? 1. Use URIs as names for things 2. Use HTTP URIs so that people can look up those names 3. When someone looks up a URI, provide useful information using standards (RDF, SPARQL) 4. Include links to other URIs, so that they can discover more things Tim Berners-Lee, http://linkeddata.org/ (Linked) Data Representation • That subject heading data follows a link-intensive data model Uniform resource identifiers (URI) Resource Description Framework (RDF) (Linked) Data Representation • Use more-or-less the same standard vocabulary Simple Knowledge Organization System (SKOS) http://www.w3.org/2004/02/skos/ For representing thesauri, classifications, etc. on the Semantic Web A SKOS graph animals cats UF domestic cats RT wildcats BT animals SN used only for domestic cats domestic cats USE cats wildcats SKOS mappings SKOS provides conceptual links to bridge across different contexts KOS 1: animals cats wildcats KOS 2: animal human object Links in the data Links in the data Growing interest for linked data in the library community Linked Library Cloud beginning 2008 [Ross Singer, Code4Lib2010] http://code4lib.org/conference/2010/singer Linked Library “sector” in 2010 Linking Open Data cloud diagram, by Richard Cyganiak and Anja Jentzsch. http://lod-cloud.net/ Libraries and LD, the perfect match? • Libraries have been producing (meta)data for ages • Libraries (often) produce high-quality metadata Libraries and LD, the perfect match? • Library metadata was locked in record silos • But it maintain links to the outside world • Bibliographic and web references • Shared vocabularies • Same books! Libraries and LD, the perfect match? LD is about • Citing object • Linking to them • Re-using data Think of web-native union catalogues A vision for the Dutch National Library Johan Stapel, Koninklijke Bibliotheek (now bibliotheek.nl) A web of cultural heritage data? ? ? The current portal Towards semantic search: facets Building a search engine on top of metadata is difficult Intrinsic quality problems: correctness, coverage Especially when data is so heterogeneous 100s of formats From flat 5-fields records to 100-nodes XML trees Language issue! We currently use a simple, flat interoperability format Quick-win quickly showing its limits Semantic ThoughtLab: experimenting solutions We can better use institutions’ original metadata Accommodate their different practices Data structures and semantics Access objects via a semantic layer of vocabularies for subjects, persons, places… Towards semantics-enabled search Building a "semantic layer" to help accessing content Towards semantics-enabled search • Enhance access to Europeana content by semantics – Query expansion, clustering of results • Exploiting various types of relations – "located in", "lived in", "is more specific concept"… • Semantics are already there, in metadata and "controlled vocabularies" used in metadata – Thesauri, classifications… • Requires to make it properly machine-accessible Europeana Data Model Trying to evolve towards RDF and Linked Data • Representing objects, persons, places, etc. as resources • Linking and re-using external sources • (Re-using) richer data modeling features SKOS, CIDOC-CRM, OAI-ORE • Enabling domain-specific data profiles • Separating original data from enrichments http://version1.europeana.eu/web/europeana-project/technicaldocuments/ Prototype: Europeana Thought Lab http://europeana.eu/portal/thought-lab.html Clustering of results Baseline: matching concepts' label Metadata for the object Controlled place name from a vocabulary at the Rijskmuseum A "more specific Egypte"? A "more specific Egypte"? Metadata for the object A place more specific than the Egypt one Semantic information on the Giza place in the Rijskmuseum Vocabulary Following other relations Following other relations - creator Metadata for the object Controlled person name from a vocabulary at the Rijskmuseum Following other relations - match Information on Gustave Le Gray from the Rijskmuseum Vocabulary Matched to a "Gustave Le Gray" from another Vocabulary Enabling bits & pieces Exploiting semantic links in CH vocabularies Concept “Giza” narrower than concept “Egypte” Mapping/alignment between CH vocabularies Louvre’s “Égypte” equivalent to Rijksmuseum’s “Egypte” Enrichment of existing metadata The string “Egypt” in a metadata record indicates the concept of Egypt defined in Rijksmuseum thesaurus Challenge #1: Linking Challenge #1: Linking Manual mapping of large vocabularies is labour-intensive • LCSH, RAMEAU and SWD mapped in the MACS project http://macs.cenl.org • SWD and DDC mapped in the CRISS-CROSS project http://linux2.fbi.fh-koeln.de/crisscross/ Automatic linking is not perfect but can help • STW, AGROVOC… • Some studies (and further pointers) for automatic library thesaurus alignment in the STITCH project http://stitch.cs.vu.nl Challenge #1: Linking • (Semi-)automatic techniques are necessary to – Connect objects to vocabularies (esp. for legacy data) – Connect objects themselves together • Crowdsourcing? • Making the way librarians create metadata evolve? Linking strategy for libraries? Linking strategy for libraries? • Links to library-originated sources – VIAF, LCSH, DDC, UDC, Worldcat, PND… • Links to resources from cultural environment – – – – Museums, archives Scientific communities: bibliographic data & research data Publishers Europeana and other aggregators Semantic Annotation Conclusion? • Linked Data won’t not solve everything right now • Just a set of techniques and a vision for better sharing, cross-linking and re-use data, fitting the web • Which is not bad! If we stop here, thanks for your attention! Any (more) questions? Some references W3C Library LD Incubator http://www.w3.org/2005/Incubator/lld • 1-year group • OCLC, LC, VU Amsterdam, DNB, etc. • help increase global interoperability of library data on the Web • bringing together people involved in Linked Data—in the library community and beyond • building on existing initiatives and collaboration tracks for the future Library LD Use Cases • LLD use cases and case studies (work in progress) http://www.w3.org/2005/Incubator/lld/wiki/UseCases • JISC cases for open bibliographic data http://obd.jisc.ac.uk Useful vocabularies to express data dublincore.org/ • Dublin Core www.w3.org/2004/02/skos/ • SKOS bibliontology.com/ • BIBO www.openarchives.org/ore/ • OAI-ORE www.foaf-project.org/ • FOAF www.loc.gov/standards/mads/rdf/ • MADS metadataregistry.org/rdabrowse.htm In progress • RDA vocabularies • FRBR@IFLA labs.mondeca.com/dataset/lov/ Cf. Linked Open Vocabularies Note: vocabularies can be combined and articulated together Datasets • Controlled vocabularies (thesauri, etc.) LCSH, DDC, Agrovoc, VIAF, GND • Bibliographic data Nat. Libraries of Hungary, Sweden • Trying to keep track of some on CKAN http://ckan.net/group/lld In the Netherlands • DEN, Bibliotheek.nl, KB, Vrije Universiteit Amsterdam, Beeld en Geluid, UvA Library • Amsterdam Museum as Linked Data http://semanticweb.cs.vu.nl/lod/am/ • Dutch Culture Link http://sites.google.com/site/dclod11/ • Dublin Core 2011 http://dcevents.dublincore.org/index.php/IntConf/dc-2011 Pictures • http://www.europeana.eu/portal/record/03903/8C5C6AEFF6B50DCCEDF6 A23A99DD3A2D66AEB2CC.html • http://www.europeana.eu/portal/record/03912/E9666896A50FDDE5F7F1 5A17C11219A7FBCBBC50.html (Europeana links give access to resources on original sites) First Demo pointers • • • • • • American LCSH French RAMEAU: German SWD: Agrovoc: STW: DBPedia: http://id.loc.gov http://stitch.cs.vu.nl/rameau http://d-nb.info/gnd/ http://aims.fao.org/ http://zbw.eu/stw/ http://dbpedia.org/