Overview of Digital Libraries:
From Requirements to Theory to
System to Projects
JCDL 2003 – Houston, TX, USA
Tutorial – May 27, 2003
Edward A. Fox
fox@vt.edu http://fox.cs.vt.edu
CS
DLRL
Internet TIC
Virginia Tech, Blacksburg, VA, USA
Acknowledgements (Selected)
• Sponsors: ACM, Adobe, IBM, Microsoft, NLM, NSF,
OCLC, SOLINET, SURA, US Dept. of Ed. (FIPSE), …
• VT Faculty/Staff: Marc Abrams, Tony Atkins, Debra
Dudley, John Eaton, H. Rex Hartson, Deborah Hix, JAN
Lee, Mann-Ho Lee, Gail McMillan, James Powell, Naren
Ramakrishnan, Shalini Urs, …
• VT Students: Fernando Das Neves, Robert France, Marcos
Goncalves, Neill Kipp, Paul Mather, Ryan Richardson, Rao
Shen, Ohm Sornil, Hussein Suleman, Wensi Xi, Ye Zhou…
Outline
•
•
•
•
•
•
•
•
•
Virginia Tech context
Why DLs? What are DLs? (5S theory)
Case Study: CSTC -> CITIDEL-> NSDL
Case Study: NDLTD
Accessibility and Visualization
DL Software: MARIAN
Interoperability: OAI, ODL
Topical Outline
Selected Links
Outline
•
•
•
•
•
•
•
•
•
Virginia Tech context
Why DLs? What are DLs? (5S theory)
Case Study: CSTC -> CITIDEL-> NSDL
Case Study: NDLTD
Accessibility and Visualization
DL Software: MARIAN
Interoperability: OAI, ODL
Topical Outline
Selected Links
Virginia Tech Background
• Largest university in Virginia, land-grant, football, town
population 35K plus 26K students
• Blacksburg Electronic Village, since 1992, with > 80%
of community on Internet
• Net.Work.Virginia, with sites for education, research,
government
• LMDS, Local Multipoint Distribution Service, gigabit
wireless networking - 1/3 of Virginia
• Math Emporium, 500 workstations
• Faculty Development Initiative, round 3
• Torgersen Hall, $30M Advanced Communications and
Information Technology Center, with DLRL
Internet Technology
Innovation Center
Supported by Virginia’s Center for Innovative Technology
Statewide University Partners - Governing Board:
• Christopher Newport University
• William Winter, William Muir, Virginia Electronic Commerce Technology
Center / Southeastern Virginia Network (VECTEC/SEVAnet)
• George Mason University
• Steven Ruth, International Center for Applied Studies in IT (ICASIT)
• Old Dominion University – Kurt Maly (CS Head), …
• University of Virginia
• Alf Weaver, Internet Commerce Group (InterCom)
• Jim French, Internet Digital Library
• Virginia Tech
• Edward Fox, Digital Library Research Laboratory (DLRL), CC, CS
• Scott Midkiff, Center for Wireless Telecomm. (CWT), VTISC, ECpE
ITIC @ VT
Research Areas
•
•
•
•
•
•
•
Collaboration (e.g., group decision support)
Community networking (e.g., BEV)
Internet access (e.g., statewide network)
Information services (e.g., digital libraries)
Modeling and simulation (e.g., Web traffic)
Usability (e.g., human factors engineering)
Virtual environments (e.g., CAVE, visualization)
Digital Libraries --- Virginia Tech
•
•
•
•
•
•
•
•
•
•
•
•
MARIAN (NLM, NSF)
CS DL Prototype - ENVISION (NSF, ACM)
TULIP (Elsevier, OCLC)
BEV History Base (NSF, Blacksburg)
DL for CS Education - EI (NSF, ACM)
WATERS, NCSTRL (NSF)
NDLTD (SURA, US Dept. of Education, NSF)
CSTC (NSF, ACM), CRIM (NSF, SIGMM)
WCA (Log) Repository (W3C)
VT-PetaPlex-1 (Knowledge Systems)
NSDL (NSF): CITIDEL, DL-in-a-Box, GetSmart
AmericanSouth.Org (Mellon)
DL Examples
•
•
•
•
•
•
IBM Digital Library
Virtua (www.vtls.com)
Greenstone (www.greenstone.org)
Eprints (www.eprints.org)
Many systems in NSF DLI projects
VT systems: MARIAN, CSTC, NDLTD
• Work on ODL, DL-in-a-box, CITIDEL, NCSTRL
Outline
•
•
•
•
•
•
•
•
•
Virginia Tech context
Why DLs? What are DLs? (5S theory)
Case Study: CSTC -> CITIDEL-> NSDL
Case Study: NDLTD
Accessibility and Visualization
DL Software: MARIAN
Interoperability: OAI, ODL
Topical Outline
Selected Links
Info.
Literacy
(1995)
NSF DLI (1994)
Improving
Education
Digital
Libraries
SGML (1985)
Multimedia
(1986)
WWW
(1994)
PDF
(1992)
Internet
(1984)
Library
Cancellations
(1988)
University
Scholarly
Electronic
Pub. (1988)
Synchronous
Scholarly Communication
Same time, Same or different place
Asynchronous, Digital Library
Mediated Scholarly Communication
Different time and/or place
Information
Life
Cycle
Borgman et al.:
Workshop Report on
Social Aspects of
Digital Libraries:
http://www-lis.gseis.
ucla.edu/DL/
Information Life Cycle
Authoring
Modifying
Using
Creating
Retention
/ Mining
Organizing
Indexing
Accessing
Filtering
Storing
Retrieving
Distributing
Networking
Communications
(bandwidth, connectivity)
Locating Digital Libraries in Computing and
Communications Technology Space
Digital Libraries
technology
trajectory: intellectual
access to globally
distributed information
Computing (flops)
Digital content
less
more
Digital Library Content
Content
Types
Text
Documents
Video
Audio
Geographic
Information
Software,
Programs
Bio
Information
Images and
Graphics
Articles,
Reports,
Books
Speech,
Music
(Aerial)
Photos
Models
Simulations
Genome
Human,
animal,
plant
2D, 3D,
VR,
CAT
Integrated CCLINC
Translingual Information System
DARPA
CCLINC
SERVER
Translation
It seems that North Korea launch a missile again
After North Korea launched a Daipodong missile
last month, NK is perceived to proceed to an additional
test launch. Korea, US and Japan enter into an alert
state, and prepare for a joint response policy. Korea
estimates that the additional launch will be on 09/05.
Japan estimates that NK’s missile range is short. US
information says that there is no sign of launch yet.
Structured Video Browser
(making video into hypermedia)
www.learn.umd.edu
• IBrowse
• Expository multimedia
• Narrative Structures
 MPEG-
MPEG-7 Image Library Systems Tech.
7
Image Library Systems
Users
Web Search Engines
WWW
1
5
Servlet
Servlet
3’
Servlet
4
Servlet Engine
MPEG-7
Description
Module
4’
2
5’
Web Server
Search Server
OS
3
DB
and Communication
ICU Information
University
 MPEG7
MPEG-7 Video Library Systems Tech.
Video Library Systems Tech.
Architecture
Video Data
Description Generator
Description
Scheme
Description Schemes
Design Tool
Player
Video
Database
Retrieval Server
Module
Presentation Module
Meta
Database
and Communication
ICU Information
University
About
• enumerate founders
know numbers,
computers, and the
Web.
• They saw the Web’s
potential to solve a
big problem:
Working
with numeric
information is
too hard!
How does enumerate help?
RDL
• Value - What is the number?
• Format - $100 [in thousands]
• Semantics - How it translates or corresponds to
other formats
• Provenance – created by whom and when?
• Measure - scale about the number:
• Units: feet, meters, $, pounds, RBI
• Magnitude: thousands, millions, billions
• Modifiers: number been manipulated?
• Structure - relationship of numbers to each other
The enumerate formula
enumerate’s interactive data
can be analyzed instantly
Standards
• Protocols/federation
• Z39.50, CIMI
• Dienst, NCSTRL
• OAI protocol
• Metadata
• TEI: inline, detailed (structure in stream)
• MARC: two-level, fine-grained
• Dublin Core: high-level, 15 elements
• RDF: describing resources/collections, annotation
• OAMS -> DC and others used in OAI
AmericanSouth.Org – Roles, Content
SOLINET
Libraries (Data Providers)
Scholars
Intellectual Organization
Controlled vocabulary
Metadata extension development
Collection Decisions
Selection Criteria
Selection Criteria
Controlled vocabulary
Central Server Maintenance
Local Server Maintenance
Provision of Context
Metadata Repository
Metadata Creation/Maintenance
Organizational Structure and
Annotation Tools
Central Interface Design/Maintenance
Local Interface Design/Maintenance
Selection of Other
Annotation
Tools
Central Indices Creation/Maintenance
Local Indices
Selection of Thesauri
Coordination of Metadata Gateway
Development
Gateway Implementation
Concept Mapping
Digital Objects
Content Area Description
Audio
Digital
Finding
Aid
MSS
Other
Photo
Video
MF
Print
Total
African-American cultural life
6
4
6
9
4
12
3
10
18
72
Agricultural crisis of late 19th century
1
1
3
1
1
4
8
19
Codification of segregation laws
1
3
2
1
8
16
Configuration of white supremacy
1
3
3
1
9
20
Cultural values and activities
3
5
17
4
15
1
5
20
71
Disenfranchising movements
1
2
2
1
2
1
6
15
Educational movements
6
1
18
6
21
3
27
98
1
1
7
10
1
1
Emergence of Holiness & Pentecostal Groups
Emergence of new musical forms
3
Expansion of Southern evangelical Protestant
Churches
3
2
3
1
9
5
1
1
Emergence of organized groups expressing
farmers concerns
1
3
1
1
2
8
2
1
8
13
9
11
23
59
Content Area Description
Audio
Digital
Expansion of industrial activity
Forms of inter-racialism
1
1
Finding
Aid
MSS
Other
Photo
6
12
5
10
1
2
Video
MF
Print
Total
5
14
52
4
10
3
3
5
15
52
2
18
57
1
Great Migration & its relationship to
worsened race relations in the South
Growth of business
1
Growth of cities & towns
1
Interplay of economic interest among regions
1
Local literature
3
Lost Cause monument movement
Political relationships between Populist &
other groups
1
1
5
12
1
13
5
12
4
13
1
4
1
2
1
6
16
2
17
4
7
3
31
68
3
8
4
9
3
1
2
1
2
2
Content Area Description
Audio
Digital
Popular magazines & newspapers
Reactions of African-American leaders to
Segregation
2
1
Finding
Aid
MSS
Other
2
2
1
2
4
1
Photo
2
Video
1
MF
Print
Total
13
17
35
1
10
24
1
1
1
8
15
2
9
25
Relationship among Southern Populists &
those in the West
Relationship between new racial system of
1890s and other
2
4
Role of immigration
1
1
2
6
4
Survival of African-American communities &
Culture
2
2
1
5
7
1
2
13
33
Women’s Groups
2
1
10
1
5
1
4
9
33
Total Each Format
41
51
161
38
133
13
79
301
831
14
Digital Libraries
Shorten the Chain from
Editor
Reviewer
Publisher
A&I
Consolidator
Library
DLs Shorten the Chain to
Author
Teacher
Digital
Reader
Editor
Reviewer
Learner
Librarian
Library
Digital Libraries --- Objectives
• World Lit.: 24hr / 7day / from desktop
• Integrated “super” information systems: 5S:
streams, structures, spaces, scenarios, societies
• Ubiquitous, Higher Quality, Lower Cost
• Education, Knowledge Sharing, Discovery
• Disintermediation -> Collaboration
• Universities Reclaim Property
• Interactive Courseware, Student Works
• Scalable, Sustainable, Usable, Useful
Benefits
• Ease of use
• Effectiveness
• “The benefits of digital libraries will not be
appreciated unless they are easy to use
effectively.” - IITA Workshop report
DLs: Why of Global Interest?
• National projects can preserve antiquities and
heritage: cultural, historical, linguistic, scholarly
• Knowledge and information are essential to
economic and technological growth, education
• DL - a domain for international collaboration
•
•
•
•
wherein all can contribute and benefit
which leverages investment in networking
which provides useful content on Internet & WWW
which will tie nations and peoples together more
strongly and through deeper understanding
R
e
a
g
a
n
M
o
o
r
e
E
d
F
o
x
Application
Domain
Related Institutions
Examples
Technical Challenges
Benefit / Impact
Publishing
Publishers, Eprint
archives
OAI
Quality control, openness
Aggregation, organization
Education
Schools, colleges,
universities
NSDL, NCSTRL
Knowledge management,
reuseability
Access to data
Art, Culture
Museum
AMICO, PRDLA
Digitization, describing, cataloging
Global understanding
Science
Government,
Academia, Commerce
NVO, PDG,
SwissProt, UK
eScience,European
Union Commission
Data models
reproducibility, faster reuse, faster
advance
(e)
Government
Government Agencies
(all levels)
Census
Intellectual property rights, privacy,
multi-national
Accountability, homeland security
(e)
Commerce,
(e) Industry
Legal institutions
Court cases, patents
Developing standards
Standardization, economic development
History,
Heritage
Foundations
Crosscutting
Library,
Archive
American Memory
Content, context, interpretation
Long term view, perspective,
documentation, recording, facilitating,
interpretation, understanding
Web, personal
collections
Multi-language, preservation,
scalability, interoperability,
dynamic behavior, workflow,
sustainability, ontologies,
distributed data, infrastructure
Reduced cost, increased access,
pereservation, democratization, leveling,
peace, competitiveness
J
u
n
e
2
0
0
2
f
o
r
N
S
F
Libraries of the Future
JCR Licklider, 1965, MIT Press
World
Nation
State
City
Community
DL Challenges
• Preservation - so people with trust DLs
• Supporting infrastructure - networks, ...
• Scalability, sustainability, interoperability
• DL industry - critical mass by covering libraries,
archives, museums, corporate info, govt info,
personal info - “quality WWW” integrating IR,
HT, MM, ...
• Need tools & methods to make them easier to build
DL Examples
•
•
•
•
•
•
IBM Digital Library
Virtua (www.vtlc.com)
Greenstone (www.greenstone.org)
Eprints (www.eprints.org)
Many systems in NSF DLI projects
VT systems: MARIAN, CSTC, NDLTD
• Work on ODL, DL-in-a-box, CITIDEL, NCSTRL
Definitions
• Library ++ (library+archive+museum+…)
• Distributed information system + organization
+ effective interface
• User community + collection + services
• Digital objects, repositories, IPR management,
handles, indexes, federated search, hyperbase,
annotation
DL Services/Activities Taxonomy (Gonçalves)
Infrastructure Services
Repository-Building
Creational
Preservational
Acquiring
Cataloging
Crawling (focused)
Describing
Digitizing
Federating
Harvesting
Purchasing
Submitting
Conserving
Converting
Copying/Replicating
Emulating
Renewing
Translating (format)
Add
Value
Annotating
Classifying
Clustering
Evaluating
Extracting
Indexing
Measuring
Publicizing
Rating
Reviewing (peer)
Surveying
Translating (language)
Information
Satisfaction
Services
Browsing
Collaborating
Customizing
Filtering
Providing access
Recommending
Requesting
Searching
Visualizing
Definition: Digital Libraries
are complex systems that
•
•
•
•
•
help satisfy info needs of users (societies)
provide info services (scenarios)
organize info in usable ways (structures)
present info in usable ways (spaces)
communicate info with users (streams)
5S Layers
Societies
Scenarios
Spaces
Structures
Streams
5S Model: Examples, Objectives
Models Examples
Objectives
Stream
Text; video; audio; image
Describes properties of the DL
content such as encoding and
language for textual material or
particular forms of multimedia data
Structures
Collection; catalog;
hypertext; document;
metadata; organization tools
Specifies organizational aspects of
the DL content
Spatial
Measure; measurable,
topological, vector,
probabilistic
Defines logical and presentational
views of several DL components
Scenarios
Searching, browsing,
recommending,
Details the behavior of DL services
Societies
Service managers, learners,
Teachers, etc.
Defines managers, responsible for
running DL services; actors, that
use those services; and relationships
among them
5S Model: Definitions
5S
Definition
Streams
Sequences of elements of an arbitrary
type
Structures
Labeled directed graphs
Spatial
Sets and operations on those sets
Scenarios
Sequences of events that modify states
of a computation in order to
accomplish some functional
requirement.
Societies
Sets of communities and relationships
among them
Overview of 5S and DL formal definitions
and compositions (Gonçalves)
relation (d. 1)
sequence graph (d. 6)
(d. 3)
measurable(d.12), measure(d.13), probability (d.14),
language (d.5)
vector (d.15), topological (d.16) spaces
sequence
tuple (d. 4)*
(d.
3)
function
state (d. 18)
event (d.10)
(d. 2)
5S
grammar (d. 7)
streams (d.9)
structures (d.10) spaces (d.18) scenarios (d.21) societies
(d. 24)
services (d.22)
structured
stream (d.29)
digital
object
(d.30)
structural
metadata
specification
(d.25)
transmission collection (d. 31)
(d.23)
repository
(d. 33)
descriptive
metadata
specification
(d.26)
metadata catalog
(d.32)
(d.34)indexing
service
hypertext
(d.36)
browsing
service
(d.37)
digital
library
(minimal) (d. 38)
searching
service (d.35)
Semantic relationships among DL concepts:
Partial concept map (Gonçalves)
Society
has
has
participates_in
actors
runs
use
scenario
managers
extend
use
Service
built_over
Repository
stores
stores
Collection
1
is_described_by
1Catalog
1
contains
contains
n
Digital Object
1
is_described_ by
conforms_with
n
Descriptive
Metadata
is_version_of
Metadata Format
translation_of
5S Framework and DL Development
(Gonçalves)
Formal
Theory/
Metamodel
5S
Requirements
5SGraph
5SL
Analysis
DL XML
Log
5SLGen
OO Classes
Workflow
Design
Components
Implementation
DL
Evaluation
Test
5SL: Stream Model: ETD example
<streams>
<text name=`ETDText'>
<content-type>text/xml
<charset>UTF-8</charset>
</content-type>
<content-type>application/pdf<content-type>
<lang>ENG</lang>
</text>
<audio name=`ETDAudio'>
<content-type=`audio/x-aiff'>
</audio>
<video name =`ETDVideo'>
<content-type=`video/mpeg'/>
</video>
. . .
</streams>
5SL: Scenario Model Example - ETD Submission
ETDReviewer
Repository
ETDWorkflowManager
GraduateSchool
Login(password)
CheckSubmittedETDs
ETDList
Identifier
[while reviewNextETD=True]
ETDReviewPage
CheckETDFiles
get(Identifier, Submission)
ETD
ETD
*GetFeesInfo
FeesInfo
FeesInfo
getDecision
decision
Accepted
Rejected
[decision=accept]
add(ETD, ETDCollection)
[decision=reject]
communicateProblem
Basic elements of DL services definition
describes
Collection
Metadata
Catalog
transforms/ aggregates value
builds
Repository-Building
Service
Instance
actor
answer
(e.g., ranked list;
digital object)
Add-Value
Service
Instance
Representation of
User interest/
need (e.g., query,
profile)
Infrastructure
Service
Instance
produces input to
Information
Satisfaction
Service Instance
5SLGen: Automatic DL Generation
Requirements (1)
5S
Meta
Model
DL
Expert
Analysis (2)
5SLGraph
DL
Designer
Practitioner
5SL
DL
Model
component
pool
ODLSearch,
ODLBrowse,
ODLRate,
ODLReview,
…….
Teacher
Design (3)
Researcher
5SLGen
Tailored
DL
Services
Implementation (4)
MARIAN DL Generation
Component
Pool
5SL
Design
XML
PARSERS:
DOM, SAX
MARIAN
API
MARIAN
Digital Library
Generator
Class
managers
Indexing
Classes
Loader
User
interfaces
Resource
Manager
Configuration
and Processing
Classes
MARIAN DL Generation Statistics
• Code Generation
NDLTD Union Archive
Indexing Classes
Generated Lines of
code
154
Class Managers and ClassIDs
342
Collection Loader and Handler
361
Document presentation and User
Interfaces
800
5SLGen for ODL
5SL-Scenario
Model (6)
DL
Designer
Component
Pool
XMI:Class
Model (3)
ODL
Search
Wrapping
Wrapping
import
import
Scenario
Synthesis (9)
Deterministic
FSM (10)
Xmi2Java (4)
Java
Classes
Model (5)
DL
Designer
StateChart
Model (8)
5SLGen
Java
ODL
Browse
XPath/JDOM
Transform (7)
XPATH/JDOM
Transform (2)
.
.
.
Java
5SL-Societies
Model (1)
SMC (11)
superclass
Java
Finite
State Machine
Class
Controller (12)
binds
Generated DL Services
JSP
User
Interface
View (13)
Information Life Cycle (plus quality
dimensions from 5S perspective – Gonçalves)
Accura
cy
Comple
ten
Conform ess
ance
Timeliness
Similarity
Active
Preservability
Organizing
Indexing
Authoring
Modifying
Semi-Active
Desirability
Retention
Mining
Reputation
Creation
Accessibility
Storing
Accessing
Timeliness
Usage
Discard
Inactive
Filtering
Utilization
Archiving
Distribution
Discovery
Searching
Browsing
Recommending
Relevance
es s
lin
e
T im
Ac
ce
ss i
bil
Networking P
res
i
er v t y
ab
ilit
y
Overview of 5SGraph
Workspace
(instance model)
Structured
toolbox
(metamodel)
DL Standardized Log Format- Design
5S
Definition
Use in Log Design
Streams
Represent static and dynamic
multimedia content
Temporal events, types of digital objects
Structures
Labeled directed graphs; provide
organization within the DL
Structured documents and metadata; structured
searches, collection, metadata catalog; hypertext,
classification scheme
Spaces
Sets, properties and operations on
those sets
Retrieval mode, Presentation information,
Scenarios
sequences of events that modify
states of a computation in order to
accomplish some functional
requirement.
Organization of the user and system actions into
transactions, statements, events and actions; DL
services as sets of scenarios.
Societies
Sets of communities and
relationships among them
User information
The Digital Library Standardized
Log Format (cont.)
• Specification
• Collection of extensive, flat set of attributes
update
catalog
event
session
help
query
collection
transaction
timestamp
response
Result
cutoff
search
search
registering
error
browse
Sorting
rule
Machine
information
action
The Digital Library Standardized
Log Format - Structure
• Top Level Hierarchy
Log
...
Log Entry
Transaction
...
Statement
SessionId
TimeStamp
MachineInfo
The Digital Library Standardized Log
Format – Structure (cont.)
• Decomposition of statement into different
types
Statement
ErrorInfo
SessionInfo
HelpInfo
RegisterInfo
Event
AdmInfo
The Digital Library Standardized Log
Format – Structure (cont.)
• Decomposition of event
Statement
ErrorInfo
SessionInfo
Event
HelpInfo
AdmInfo
RegisterInfo
Action
Search
Browse
StatusInfo
Update
StoreSysInfo
The Digital Library Standardized Log Format
– Structure (cont.)
• Search Attributes
Search
TimeFrame
Collection
PresentationInfo
Catalog
SearchBy
QueryString
Format
SortBy
NumberOfResults
CutOff
DL Log Tool and Implementation
Next
Generation
2nd Generation
DL
Cx
DL
1st Generation
(e.g., CITIDEL)
DL
(e.g., MARIAN)
Monolitical
Log
Tool
Socket
Hierarchical
Log
Tool
XML Log Repository
DL
Cy
DL
DL
Cz
Standard
Protocol
(XOAI)
Componentized
Log
Tool
Creating the Clickstream Stats
Use Activity File
Step 1:
The user activity file is input into
a clickstream stat generator.
User 4532; 25 Logons, 22 Logoffs, 3 accesses from .edu, 2
hits from .gov, history:: Logon page [13 may 2003, 16:00] ->
Browse page [13 may 2003, 16:02] -> search page [13 may
2003, 16:04] -> results page [13 may 2003, 16:04] -> view
document 254 page [13 may 2003, 16:07] -> download page
[13 may 2003, 16:10] -> logoff page [13 may 2003, 16:11]
User 4555432; 3 Logons, 0 Logoffs, 1 accesses from .mil, 2
hits from .com, history: Logon page [12 may 2003, 12:00] ->
Browse page [12 may 2003, 12:02] -> logoff page [12 may
2003, 12:03]
Step 1: intermediate
Statistics Files are
Used as input
Etc. etc. etc
Clickstream stat
generator
Step 2:
The clickstream generator
produces aggregate statistics (i.e.,
average transition time from
browse to results page, the
average time spent on each page,
etc).
Step 2: Clickstream
Data is produced
Clickstream
stats
Step 3: GUI is
used
To produce usage
Statistics,
clickstream
Stat visual aids,
etc.
Visualizations
Visualizer
(GUI)
Step 3:
The clickstream stats are output
in both text and visual format.
For example, the average path
through a website can be
displayed, and each page of a
website can include hit statistics
and time-on-page statistics.
OCKHAM
•
•
•
•
Simplicity (a la OCCAM’s razor)
Support by Mellon and DLF
Next meeting in Atlanta Jan. 8, 2003
Four main ideas:
1. Components
2. Lightweight protocols
3. Open reference models (e.g., 5S, OAIS)
4. Community perspective and involvement
Problem
Why do DL developers continue to “reinvent
the wheel”? The top 10 reasons are:
1. The library budget won’t allow purchase of a
commercial DL system.
2. Unless the development effort is local, there
won’t be any control.
3. DLs are extensions of DBMSs, so they are
simple applications to develop.
4. Since DLs operate on the Web, one must adopt
the newest W3C proposal.
Problem – cont’d
5. Since technology moves so quickly, it is
essential to follow the latest fad.
6. CS students always develop from scratch.
7. This team knows it can do it better.
8. This system must have more capabilities than
any other system.
9. This DL has to be more flexible and extensible.
10. This is the right system architecture – at last!
Problem Approach
We
• address the problem of how to develop DLs;
• build on experience in building many DLs;
• strive for simplicity as per OCKHAM initiative;
• build upon the Open Archives Initiative;
• demonstrate our approach in diverse situations;
• and invite all to
• use DL-in-a-box and
• help build Open Digital Libraries.
Outline
•
•
•
•
•
•
•
•
•
Virginia Tech context
Why DLs? What are DLs? (5S theory)
Case Study: CSTC -> CITIDEL-> NSDL
Case Study: NDLTD
Accessibility and Visualization
DL Software: MARIAN
Interoperability: OAI, ODL
Topical Outline
Selected Links
CS -> CSTC -> CRIM
• NSF and ACM Education Committee are funding
a 2 year project “A Computer Science Teaching
Center” - CSTC - http://www.cstc.org/
• College of NJ, U. Ill. Springfield, Virginia Tech
• Focus initially on labs, visualization, multimedia
• Multimedia part is also supported by a 2nd grant
to Virginia Tech and The George Washington
University: http://www.cstc.org/~crim/ (with
curricular guidelines also under development)
CS Teaching Center (CSTC)
• Instead of building large, expensive multimedia packages,
that become obsolete and are difficult to re-use, concentrate
on small knowledge units.
• Learners benefit from having well-crafted modules that
have been reviewed and tested.
• Use digital libraries to build a powerful base of support for
learners, upon which a variety of courses, self-study
tutorials & reference resources can be built.
• ACM support led to Journal of Educational Resources in
Computing (JERIC), accessible from www.cstc.org
Browsing (1)
Browsing (2)
SMETE Library -> NSDL
(from www.dlib.org to NSF DLI-2)
• Context: Global movement toward Digital
Libraries (see April 1998 CACM)
• NSF 00-44 effort: Science, Mathematics,
Engineering, and Technology Education
Digital Library (focussed on undergraduates)
• 3 workshops, yearly increasing funds / new calls
• NSDL will operate as a distributed federation,
with separate parts for each key discipline, and
should lead to a global effort.
Selected NSDL Early
Projects/Topics
COLLEGIS Res. Inst.
IMS, CS, Math, Viz., …
Columbia University
Earth sciences
Stanford University
Medicine (images)
U. California Berkeley
Engineering
University of Maryland
K-12 education
U. Texas at Austin
Physical anthropology
Computing and Information
Technology Interactive Digital
Educational Library (CITIDEL)
• Domain: computing / information technology
• Genre: one-stop-shopping for teachers &
learners: courseware (CSTC, JERIC), leading
DLs (ACM, IEEE-CS, DB&LP, CiteSeer),
PlanetMath.org, NCSTRL (technical reports), …
• Submission & Collection: sub/partner
collections  www.citidel.org
www.CITIDEL.org
• Led by Virginia Tech, with co-PIs:
• Fox (director, DL systems)
• Lee (history)
• Perez (user interface, Spanish support)
• Partners
• College of New Jersey (Knox)
• Hofstra (Impagliazzo)
• Villanova (Cassel)
• Penn State (Giles)
Overview of CITIDEL architecture
USER PORTALS
DIGITAL LIBRARY SERVICES
REPOSITORIES
Distributed repository structure
Digital Library Services
OAI
Data
Provider
Applets
Repository
OAI
Data
Harvester
Union Metadata
Repository
Laboratories
Repository
Syllabi
Repository
Papers
Repository
...
Digital library architecture for local
and interoperable CITIDEL services
EDUCATORS
Multilingual
Searching
LEARNERS
Browsing
Union Metadata
Filtering
Filtering Profiles
OAI
Data
Provider
Annotating
ADMINISTRATORS
Revising
Administering
User Profiles
Annotations
OAI
Data
Harvester
Remote and Peer Digital Libraries (eg. NSDL -CIS)
PORTALS
SERVICES
REPOSITORIES
CITIDEL: Computing & Information Technology Interactive Digital Educational Library
Technology Features
•Component architecture (Open Digital Library)
Re-use and compose re-deployable digital library components.
•Built Using Open Standards & Technologies
•XSL and XML: Interface Rendering
•Perl: Component Integration
•ESSEX: Search Engine Functionality
•Open Archives Initiative
•Used to collect DL Resources and DL Interoperability
CITIDEL Front Page
User Features
•Very large collection
Over 400,000 Resources from ACM, SIGCSE, JERIC, CSTC,
NDLTD, NCSTRL, DBLP
•Filtered browsing and searching
Filters based on these user-selected sub-communities. Also
allows customization in addition to views of all results.
•Multiclassification browser
Supports browsing based on curricula (familiar, professional
society approved) in computing and related disciplines, as well
as on classification schemes.
•Activity collection creation & tools
1. The core of CITIDEL is the collection data support. This consists centrally of a union
catalog, metadata cache, semantic links table, integration tables, and more.
2. The harvesting system populates the union catalog and the secondary tables from the
contents of remote digital library collections, over Open Archives.
3. For collections which lack an Open Archive provider, ad hoc importing facilities must be
constructed.
4. CITIDEL serves up the contents of its union catalog via an Open Archives data provider,
giving other digital libraries (NSDL) access to CITIDEL's metadata.
5. The application layer data support consists of non-content-related tables and
personalization tables, such as a table of users and preferences.
6. The filtering system relies on extensive database support for speed.
7. The service modules tackle the DL features of search engine, recombination into
annotated and enriched lists, creation of pedagogical activities utilizing DL resources, and
posting messages to DL resources.
8. The CITIDEL application ties it all together in a single user interface. Most presentation
(but not all) is handled here.
Faculty and students can extract resource references from
CITIDEL search collections into learning activity templates, for
sharing and interchange (with versioning).
VIADUCT assists in the development of a totally independent,
self-generated, educational resource collection within CITIDEL.
IAVT is based on Utah State’s Instructional Architect.
Browsing and Searching with Filters
Users are placed in chosen sub-communities. They can filter results based
on these sub-communities. Also there is further customization.
Alternatively, users may view all results. Users may set up multiple filters
for simple or complex filtering based on many factors such as education
level, role, resource type, language, source, and much more. This allows
users to get exactly what they are or are not looking for in the digital
library. At any time, users are free to disable these filters or see results
excluded by them.
Future Developments
•Expanding further to cover Information Technology
•Advanced searching and additional services
•Expansion of the collection from many sources
•Collaborative Internationalization and Translation
System
•Assessment and evaluation
•Workshops
Web Page: www.citidel.org
Multiclassification Browser
The multiclassication browser allows users to browse through the CITIDEL
collections based on professional society approved curricula in computing as
well as classification schemes. As users span many disciplines related to
computing, the users may browse within the scheme with which they are most
familiar. Resources are cross-classified wherever possible through these
schemes. The current schemes include the 2001 ACM/IEEE-CS Computing
Curricula, the 1998 ACM Computing Classification System, the Computing
Research Repository Subject Areas, and the 2000 AMS Mathematics Subject
Searching
CITIDEL searching, which is driven by the ESSEX search engine for
relevance computation, also provides a list of relevant categories within
the classification schemes (see sidebar, left).
CITIDEL -> NSDL
• A collection project in the
• National STEM (science, technolgy,
engineering, and mathematics) education
Digital Library – NSDL
•
-> LEARNS
National Science Digital Library
(NSDL)
• Domain: undergraduate and K-12
education, etc.
• Genre: educational resources
• Submission & Collection: sites of
90 projects  www.nsdl.org
Advancing Education
through
Community
Building
Sharing
supported by
Digital
Libraries
Educational
Resources
NSDL Information Architecture
Essentially as developed by the Technical Infrastructure Workgroup
Portals &
Portals &
Clients
Portals &
Clients
Clients
User
Interfaces
Core
NSDL
“Bus”
NSDL
NSDL
NSDL
Collections
Collections
Collections
Collection
Building
referenced
referenced
items&&
Special
items
collections
Databases
collections
Core
Core Services:
Collectionmetadata
Building
Core gathering
CollectionServices
protocols
Building
Services
harvesting
NSDL
NSDL
Services
Other
NSDL
Services
Services
Usage
Enhancement
Core
Services:
CI Services
information
retrieval
CI Services
browsing
CI
Services
authentication
CI Services
personalization
CI Services
discussion
annotation
A Learning Environments and Resources
Network for SMET Education (LEARNS)
“The network is the library.”
LEARNS Connects:
Users: students, educators, life-long learners
Content: structured learning materials; large
real-time or archived datasets; audio, images,
animations; primary sources; digital learning
objects (e.g. applets); interactive (virtual,
remote) laboratories; ...
Tools: search; refer; validate; integrate;
create; customize; publish; share; notify;
collaborate; ...
LEARNS Supports:
Learning communities
Users
(profiles)
Application services
Tools
Customizable collections
Content
(metadata)
(protocols)
LEARNS Enables:
Environments for
• Discovery
• Communication
• Stability
• Collaboration
• Reliability
• Creation
AND
• Reusability
• Validation
• Interoperability
• Evaluation
• Customizability
• Recognition
• ...
• ...
of Resources
Goal
Core Integration
Track
(FY00 pilots,
FY01 full)
Collections Track
Services Track
Targeted Research
Track
LEARNS
operational
by 2002
Expectations of NSDL
ProgramTracks
• Core Integration: coordinate a distributed alliance of
resource collection and service providers; and ensure
reliable and extensible access to and usability of the
resulting network of learning environments and resources
• Collections: aggregate and actively manage a subset of the
digital library’s content within a coherent theme / specialty
• Services: increase the impact, reach, efficiency, and value
of the digital library in its fully operational form
• Targeted (Applied) Research: have immediate impact on
one or more of the other three tracks
Collections
•
•
•
•
Discovery of content
Classification and cataloguing
Acquisition and/or linking; referencing
Disciplinary-based themes define a natural body of
content, but other possibilities are also encouraged
• Access to massive real-time or archived datasets
• Software tool suites for analysis, modeling,
simulation, or visualization
• Reviewed commentary on learning materials and
pedagogy
Services
• Help services, frequently asked questions, etc.
• Synchronous/asynchronous collaborative learning
environments using shared resources
• Mechanisms for building personal annotated
digital information spaces
• Reliability testing for applets or other digital
learning objects
• Audio, image, and video search capability
• Metadata system translation
• Community feedback mechanisms
Outline
•
•
•
•
•
•
•
•
•
Virginia Tech context
Why DLs? What are DLs? (5S theory)
Case Study: CSTC -> CITIDEL-> NSDL
Case Study: NDLTD
Accessibility and Visualization
DL Software: MARIAN
Interoperability: OAI, ODL
Topical Outline
Selected Links
A Digital Library Case Study
• Domain: graduate
Project:
education, research
Networked Digital
• Genre:ETDs=electronic Library of Theses &
theses & dissertations
Dissertations
• Submission:
(NDLTD)
http://etd.vt.edu
http://www.ndltd.org
• Collection:
http://www.theses.org
Alphabet Soup - Factoring
• NDLTD = ND LTD
• (Paul Mather – from UK)
• NDLTD = NDL TD
• (Edie Rasmussen)
• (Later, Networked University Digital
Library = NUDL
The Networked Digital Library of Theses and Dissertations
www.NDLTD.org
Training Authors
Expanding Access
Preserving Knowledge
Improving Graduate Education
Enhancing Scholarly Communication
Empowering Students & Universities
Leader of the Worldwide ETD
(Electronic Thesis and Dissertation) Initiative
NDLTD
Grad
Program
IT
Library
Ed.
(Tech)
ETDs Got Your Interest?
ETD Web Site
http://www.ndltd.org/
Graduate Students
U. Laval
Media
Singapore AM
Chronicle of Higher Ed.
National Public Radio
NY Times ...
Key Ideas:
Scalability
Networked infrastructure
University collaboration
Workflow, automation
Education is the rationale
Maximal
Access
8th graders vs. grads
Authors must submit
Standards
PDF, SGML, MM,
MARC, DC, URNs,
Federated search
What are the long term goals?
• 400K US students / year getting grad degrees are
exposed / involved
• 200K/yr rich hypermedia ETDs that may turn into
electronic portfolios (images, video, audio, …)
• Dramatic increase in knowledge sharing: literature
reviews, bibliographies, …
• Services providing lifelong access for students:
browse, search, prior searches, citation links
• Hundreds/thousands of downloads / year / work
ETDs: Library Goals
• Improve library services
• Better turn-around time
• Always available
• Reduce work
• catalog from e-text
• eliminate handling: mailing to UMI,
bindery prep, check-out, check-in,
reshelving, etc.
• Save space
Grad Student Workstation?
• Record all work with NDLTD, return to
prior situation, prepare bibliography
• Powerful (multilingual, text, image)
searching, browsing (with categories),
following citation links
• Support collaboration with others in same
field: help with literature review, sharing
tools and data sets, applying their methods
What are we doing?
• Aiding universities to enhance grad educ.,
publishing and IPR efforts: to help
improve the availability and content of
theses and dissertations
• Educating ALL future scholars so they can
publish electronically and effectively use
digital libraries (i.e., are Information
Literate and can be more expressive)
• Demonstrating how for other organizations
Student Prepares Thesis/Dissertation
NDLTD
Literature
Computer Resources
Research
Student Defends & Finalizes ETD
My Thesis
ETD
Student Gets Committee
Signatures and Submits ETD
Signed
Grad School
Graduate School Approves ETD,
Student is Graduated
Ph.D.
Library Catalogs ETD, Access is
Opened to the New Research
WWW
NDLTD
Available at VT
• Information
http://scholar.lib.vt.edu/theses
• Automated submission system ready for
customization
http://scholar.lib.vt.edu/ETD-db/
• Student guidelines, training materials, FAQ's,
multimedia educational materials
http://etd.vt.edu
• NDLTD: Network educational institutions
• Annual conferences: Berlin 2003, U of Kentucky 2004
http://www.ndltd.org
ETDs at Virginia Tech
• Partnership: Library, Graduate School, and
Faculty
• Approved by university governance- Mar.1996
• Full implementation- Jan.1997
• Web submission
• Students: http://etd.vt.edu
• Programmers: http://scholar.lib.vt.edu/ETD-db/
• Workshops for students (and faculty)
• Over 5000 ETDs approved
How are ETDs managed?
•
Graduate student creates ETD
•
•
•
Graduate student submits ETD
•
•
•
Directly to library server/permanent archive
Archiving fee replaces binding fee
Graduate School approves
•
•
•
•
Word processor, multimedia
Saves as PDF, usually
E-mails author, advisor, UMI (VT scripts)
Authors/advisors prescribe Internet access
Library catalogs and archives
UMI downloads
Archiving ETDs
• Every 15 minutes back-ups made of notyet-approved submissions
• Hourly back-ups of newly approved ETDs
• Weekly back-ups of entire ETD collection
• Copies stored on-site and off-site
VT ETD Cataloging
• same as current cataloging policies, except:
• author-assigned keywords (not LCSH)
• generic (not LC) call no.
• fields/subfields as required for computer files
• full abstracts
• time savings
• cataloger familiar with computer files
• equipment, software for word processing
• 5 minutes avg. (10-15 minutes for paper TDs)
Library Costs
• $12/vol. for paper thesis processing
• catalog, bind, security strip, label, shelve
• @950 vols./yr. = $11,466
• $3.20/vol. ETD processing
• cataloging @950 vols./yr. = $3040
• $.07/vol. shelving
• $.04/vol. circulation
Costs/Savings at VT
• Graduate School stopped shipping to the library
3000 copies of paper TDs/year
• Library stopped binding, shelving, and circulating
3000 copies of TDs/year
• 166 ft of shelf space saved/year by the library
• VT used existing equipment in Library (vs. start-up
costs for staff, hardware and software from from a
zero-base estimate: $65,000 – see
http://scholar.lib.vt.edu/theses/)
Popular Works 1996
458 Seevers, Gary L. Identification of Criteria for Delivery of Theological Education Through
Distance Education: An International Delphi Study (Ph.D., Educational Research and
Evaluation, April 1993; 1353Kb)
432 Hohauser, Robyn Lisa. The Social Construction of Technology: The Case of LSD (MS in
Science and Technology Studies, Feb. 1995; 244Kb)
390 Childress, Vincent William. The Effects of Technology Education, Science, and
Mathematics Integration Upon Eighth Grader's Technological Problem-Solving Ability (Ph.D.
in Vocational and Technical Education, July 1994; 285Kb)
310 Kuhn, William B. Design of Integrated, Low Power, Radio Receivers in BiCMOS
Technologies (Ph.D. in Electrical Engineering, Dec. 1995; 2Mb)
287 Sprague, Milo D. A High Performance DSP Based System Architecture for Motor Drive
Control ( MS in Electrical Engineering, May 1993; 878Kb)
165 Wallace, Richard A. Regional Differences in the Treatment of Karl Marx by the Founders
of American Academic Sociology (MS in Sociology, Nov. 1993; 479Kb)
150 McKeel, Scott Andrew. Numerical Simulation of the Transition Region in Hypersonic
Flow (Ph.D. in Aerospace Engineering, Feb. 1996; 3Mb)
Popular Works 1997
9920 Liu, Xiangdong. Analysis and Reduction of Moire Patterns in Scanned Halftone Pictures
(Ph.D. in Computer Science, May 1996; 6.6Mb)
7656 Petrus, Paul. Novel Adaptive Array Algorithms and Their Impact on Cellular System
Capacity (Ph.D. in Electrical Engineering, March 1997; 5Mb)
2781 Agnes, Gregory Stephen. Performance of Nonlinear Mechanical, Resonant-Shunted
Piezoelectric, and Electronic Vibration Absorbers for Multi-Degree-of-Freedom Structures
(Ph.D. in Engineering Mechanics, Sept. 1997; ? + 7926Kb)
2492 Gonzalez, Reinaldo J. Raman, Infrared, X-ray, and EELS Studies of Nanophase Titania
(Ph.D. in Physics, July 1996; 4607Kb)
1877 Shih, Po-Jen. On-Line Consolidation of Thermoplastic Composites (Ph.D. in Engineering
Mechanics, Feb. 1997; 3.3Mb)
1791 Saldanha, Kevin J. Performance Evaluation of DECT in Different Radio Environments
(MS in Electrical Engineering, Aug. 1996; 3.2Mb)
1431 DeVaux, David. A Tutorial on Authorware (MS in CS, April 1996; 2.3Mb)
1394 Kuhn, William B. Design of Integrated, Low Power, Radio Receivers in BiCMOS
Technologies (Ph.D. in Electrical Engineering, Dec. 1995; 2518Kb)
ETD Benefits:
Low margin, high use
• Incorporate ETDs with other digital library activities
• Ejournals, online class materials, digital images, etc.
• Additional equipment, staff may not be necessary
• http://scholar.lib.vt.edu/theses/data/setup.html
• Use VT programs, scripts, etc.
• http://scholar.lib.vt.edu/ETD-db/
• Online accesses vs. circulation of copies
• VT theses 1990-1994, combined average circulation per
copy: 2.24/yr
• VT dissertations 1990-1994, combined average circulation
per copy: 3.2/yr
Access to VT’s ETDs
http://scholar.lib.vt.edu/theses/
5,000,000
4,500,000
4,000,000
3,500,000
3,000,000
2,500,000
2,000,000
1,500,000
1,000,000
500,000
ETD files requested
Abstracts requested
1997/98
231,709
165,710
1997/98
483,030
215,493
1999/00
578,152
260,699
2000/01
2,173,420
573,149
2001/02
4,497,199
471,917
Why are ETDs so popular?
• User surveys
•
•
•
•
•
67% found VT ETDs easily
61% found them by searching
22% browsed by department
16% browsed by author
53% downloaded 1 or more ETDs
• Author surveys
• Conversion and submission processes less difficult than
anticipated
• Over half plan to publish articles from their ETDs
• Why did they restrict access?
http://lumiere.lib.vt.edu/surveys/
Q uickTim e™ and a
Cinepak decom pr essor
ar e needed t o see t his pict ur e.
http://scholar.lib.vt.edu/theses/available/etd-2227102539751141/
Brief History of ETD Meetings
• 1987 mtg in Ann Arbor: UMI, VT, …
• 1992 mtg in Washington: CNI, CGS, UMI, VT and 10 universities
with 3 reps each
• 1993 mtg in Atlanta to start Monticello Electronic Library (regional,
US Southeast): SURA, SOLINET
• 1994 mtg at VT: std: PDF + SGML + multimedia objects
• 1996 funding by SURA, US Dept. of Education (FIPSE)
• 1997 meetings in UK, Germany, ...
• 1998 – 1st symposium – Memphis (20)
• 1999 – 2nd symposium – Blacksburg (70)
• 2000 – 3rd symposium – St. Petersburg (225)
• 2001 – 4th symposium – Caltech (200)
• 2002 – 5th syposium – BYU, Provo, Utah
• 2003 – 6th syposium – Berlin (215)
• 2004 – 7th syposium – U. Kentucky
• 2005 – 8th syposium – Sydney, Australia
NDLTD Membership
•
•
•
•
•
As of 5/17/2003 there were at least:
176 members, including:
155 individual universities
6 consortia
21 institutional members
National / Regional Projects
• Australia
•
•
•
•
•
•
•
U. New South Wales (lead)
U. of Melbourne
U. of Queensland
U. of Sydney
Australian National U.
Curtin U. of Technology
Griffith U.
• Belgium
• Brazil
• Germany
• Humboldt University (lead)
• 3 other universities
• 5 learned societies: Math, Physics,
Chemistry, Sociology, Education
• 1 computing center
• 2 major libraries
• India
• Lithuania
• Spain: Consorci de Biblioteques
Universitàries de Catalunya, as
group, www.cbuc.es: 9 sites
• Sudan
• UK (British Library, JISC,
Edinburgh)
• UNESCO (especially Latin
America, Eastern Europe, Africa)
• USA:
• CIC (“Big 10”)
• Ohio: OhioLINK: 79 colleges/univs
• SOLINET
• …
OhioLINK
•
•
•
•
•
•
Statewide Consortium
Represents 79 colleges, universities, libraries
Public Universities
Private Universities and Colleges
2-Year Colleges
Only a few (e.g., Miami U. of Ohio) are also
NDLTD members on their own
US University Members
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
Air University (Alabama)
Baylor University
Boston University
Brigham Young University
Caltech
Clemson University
College of William & Mary
Concordia University (Illinois)
Drexel University – required 4/2002
East Carolina University
East Tenn. State U. – required 1/2001
Florida Institute of Technology
Florida International University
Florida State University
Florida Tech
George Washington University
Georgetown University
Johns Hopkins University
Louisiana State University – required 1/2002
Marshall University (W. Va.)
Miami University of Ohio
Michigan Tech
Mississippi State University
MIT
Montana State University
Naval Postgraduate School (CA)
New Jersey Inst. of Technology
New Mexico Tech
North Carolina State University – required 9/2002
Northwestern University
Penn. State University
Regis University
Rochester Institute of Tech.
Texas A&M
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
U. of Central Florida
U. of Colorado Health Science Center
U. of Florida – required 8/2001
U. of Georgia – required 9/2001
U. of Hawaii, Manoa
U. of Illinois, Urbana-Champaign
U. of Iowa
U. of Kentucky – required in CS only
U. of Maine – required in CS, Spatial Info Sci/Eng
U. of Missouri-Columbia
U. of North Texas – required since 8/99
U. of Oklahoma
U. of Nevada, Las Vegas
U. of New Orleans
U. of North Texas – required 8/1999
U. of Oklahoma
U. of Pittsburgh
U. of Rochester
U. of South Florida – required 8/2002
U. of Tennessee, Knoxville
U. of Tennessee, Memphis
U. of Texas at Austin – required 6/2001
U. of Virginia – required 1/2003
U. of West Florida
U. of Wisconsin - Madison – part reqt 12/1999
Vanderbilt U.
Virginia Commonwealth U.
Virginia Tech - required 1/97
Wake Forest U.
West Virginia U. - required 8/1998
Western Kentucky U. – required 9/2004
Western Michigan U.
Worcester Polytechnic Inst. – required 7/2002
Yale U.
Other Countries (selected)
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
Australia
Belgium
Brazil
Canada
Chile
China, Hong Kong
Columbia
Finland
France
Germany
Greece
India
Italy
Jamaica
Korea
Lithuania
Mexico
•
•
•
•
•
•
•
•
•
•
•
•
•
•
Netherland
Norway
Poland
Russia
Singapore
S. Africa
S. Korea
Spain
Sudan
Sweden
Taiwan
Thailand
UK
Venezuela
Institutional Members
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
Australian Digital Theses Program
British Library
Cinemedia
Coalition for Networked Information (CNI)
Committee on Institutional Cooperation (CIC)
Consorci de Biblioteques Universitàries de Catalunya
Diplomica.com
Dissertation.com
Dissertationen Online (Germany)
ETDweb, a Division of Answer4.com
Ibero-American Science & Technology Education Consortium (ISTEC)
MathDISS International
National Documentation Centre (NDC), Greece
National Library of Canada
National Library of Portugal
OCLC Online Computer Library Center
Office of Scientific and Technical Info (US Dept of Energy)
OhioLINK
Organization of American States (SEDI/OAS)
Southeastern Library Network (SOLINET)
Sudanese National Electronic Library
UNESCO (www.unesco.org/webworld/etd)
UNESCO and ETDs
• Promoting the use of the Internet as a tool for disseminating
scientific knowledge
• Facilitating the transfer of ETD expertise from developed to
developing countries
• 1998: Member of the NDLTD Steering Committee
• 1999: First UNESCO ETD meeting on ETD
internationalisation
• 2002: “UNESCO Guide to Electronic Theses and Dissertations”
• 2003: Model training programmes and training courses
• 2003: Sponsor pilot projects
• 2003: Pilot projects (Africa, Europe, Latin-America)
For professional societies
• Like “writing across the curriculum”, e.g.,
Chemical Markup Language, MathML, …
• Besides writing: computing/communications,
information literacy, personal digital library
management, tool use, research methods,
collaboration, archiving/preservation
• Data sets, communities of users of them
• Classification systems / browsing / searching
• NRC’s “Issues for Science and Engineering
Researchers in the Digital Age”, 57 pages
Relationship with publishers
• Concern of faculty and students that still wish
to publish books or journal articles, voiced:
campus, Chronicle, NPR, Times
• Solution: Approval Form gives students,
faculty choices on access, when to change
access condition; use IPR controls in DL
• Solution: by case, work with publishers and
publisher associations to increase access
• AAP, AAUP
• AAAS, ACM, ACS, Elsevier, ...
Some responses from publishers
•
•
•
•
•
ACM: need to acknowledge copyright
Elsevier: need to acknowledge copyright
IEEE-CS: endorse initiative
ACS: After first publication, can release
Textbook publishers: different market,
manuscript significantly reworked
• General: restricting access to local campus
will not cause any problems
How does this relate to
ProQuest/UMI?
• Generally, they are independent decisions.
• 1987 UMI workshop was first to explore ETDs.
• UMI wrote support letter for US Dept. of Ed. proposal.
• UMI is on Board of Directors (formerly Steering
Committee).
• ProQuest Direct pilot of scanning works started 1/1/97,
with free 2 yr access to front part.
• We are collaborating on:
• accepting electronic author submissions
• standards (e.g., representation)
ETD Initiative (and UMI)
Students
Learn about
DL, EPub
TDs
become more
expressive
Global TDs
become more
accessible,
archived
Universities
UMI
N. Amer. (T)Ds are
accessible, archived
User Search Support
(multilingual, XML)
NDLTD World Federated
Search
User
Interface
Virginia Tech ...
(univ)
Dissertations
Online
(Germany)
OhioLink
Portugese NL ...
(lib / univ group)
(national lib)
Australia
(regional)
OAS,
ISTEC
(Latin
America)
Note: All groups shown are connected with NDLTD.
www.theses.org
• James Powell student project, D-Lib
Magazine description in Sept. 1998
• XML description of each site
• type of search engine / service
• language
• coverage (for resource discovery)
• Adding Z39.50 gateway capability and
integrating with MARIAN, along with Harvest
and Open Archives protocols
Access Approaches
• Goal: Maximize access and services, e.g., by
encouraging:
• UMI centralized services
• VTLS: free union collection of ETD vmetadata
• OCLC: free union collection of TD metadata
• Distributed service: Dienst, Z39.50
• Regional services (e.g., OhioLinkh)
• Local servers with browse, search
• From local catalogs to local archives
• WWW robot indexing and search services
Access Possibilities
Web
search
engines
www.
theses.
org
Virginia MIT National
Tech
Library of
Portugal
www.
library
openarchives. catalog
org
clients
CBUC
(Spain)
Ohio
Link
3rd
Party
Services
(e.g.,
UMI)
National
Projects:
AU, GE, …
Why might a university want
to be involved?
• To improve graduate education / better prepare
your students / increase their knowledge (epub,
DLs, IPR) and visibility
• To enhance university infrastructure (DL)
• To unlock university information
• To save money for students and for the
university / improve workflow
• To build an important digital library (of ETDs)
NDLTD Members and ETD-MS
• NDLTD members will
• Share metadata for their ETDs
• Providing that in either ETD-MS
• Or if they use a version of MARC locally,
work to have that eventually shared in
either MARC21 or UNIMARC
• Run OAI, either locally or in consortia, so
their metadata can be harvested, according
to necessary terms and conditions
Complex to Simple
MARC ($50)
Dublin Core (DC)
+
thesis
ETD-MS
• ETD Metadata Standard
• XML-encoded metadata standard
(content and encoding) for Electronic
Theses and Dissertations (ETDs)
• in part conforming to Dublin Core (DC)
• using RDF
• using UNICODE
• Will specify relationship with MARC
ETD-MS Schema Includes
• Elements not in dces (Dublin Core Element Set)
• e.g., thesis.degree
• Elements with wildly divergent semantics
• e.g., thesis.advisor rather than dc.contributor
• Relationships to other elements
• Controlled vocabularies
• e.g., {Bachelors, Masters, Doctorate, Other} for
thesis.degree.level
• Labels in multiple languages
ETD Encoding Decisions
• Text
• UNICODE (with language identifiers)
• Structure
• MARC (MARC-21 or UNIMARC)
PLUS
• XML / RDF / DC + ETD
• Multimedia
• Following international standards
• Other schemes may not be amenable to
preservation
RDF for ETDs
• WWW Consortium (W3C)’s RDF: Resource
Description Framework
• NUDL ETD metadata realized as an RDF
application profile
• Specifying elements from DC element set
• Plus new elements from a registered ETD schema
• Constraints & policies attached to both
• (e.g., “Full title,” “Name as it appears on title page,” “Repeatable”)
• Links to authority records encoded as URIs
• XML syntax as per RDF standard
OCLC and ETD-MS
• Identify TDs in WorldCat (4.3M)
• Through OAI make available metadata for
WorldCat TDs in both DC and ETD-MS
• Provide an authority service for personal
names for NDLTD
• Coordinate with other authority services
such as LC
VTLS and ETD-MS
• Support NDLTD through a union catalog service
implemented with Virtua
• Accept metadata in MARC21 or UNIMARC, and
help identify other converters for other types
• Accept metadata in one other format, namely
ETD-MS, collected using OAI (harvesting)
• Accept data in various character sets, with
UNICODE preferred, but in some cases the
submitter may be required to convert
Union Catalog
(with
Vinod Chachra,
Thom Hickey)
NDLTD Union Catalog Statistics
1. Participating Countries

So far ETDs from 7 countries are included in the database.
 Canada
 Germany
 Greece
 Korea
 Portugal
 Spain
 U.S.

UK to be added by June 30, 2002.
Brazil to be added soon.

NDLTD Union Catalog Statistics
2. Interface Languages in Union Catalog



The language here is the language of the interface
The VTLS NDLTD Union Catalog has 14 languages:

English, Arabic, Catalan, Chinese

French, German, Hebrew, Korean

Polish, Portuguese, Russian, Slovak

Spanish and Swedish
Example follows
German
NDLTD Union Catalog Statistics
3. Languages in the Union Catalog



The language here is the language of the content of ETD
The VTLS NDLTD Union Catalog has data in 6 different
languages. These are:
 English
 German
 Greek
 Korean
 Portuguese
 Spanish
Examples follow
Language = German; hits = 137
Full record display
Language = Greek
In Greek
In English
Union Catalog Creation
Name Authority
Service
(e.g. OCLC)
NDLTD Central
VTLS Union
Catalog
NDLTD Site / Member
Librarian
Verification /
Validation /
Enrichment /
Maintenance
Student
Entry
OAI
Server
Local DB
MARIAN
Union
Catalog
Virtua
MARC DB
OAI
Harvester
Conversion
Local
Search /
Brow se
Alternate MARC
Transport (ftp?) tapes?)
NDLTD Union Catalog Architecture
VT ODL Demo
Search/Browse
SRU/SRW
(search) OAI-PMH
TD OAI
ETD OAI
OCLC
Repository
Repository
OAI-PMH
Virtua
VTLS
Union
Catalog
OAI-PMH
OAI-PMH
WorldCat
Try:
Z39.50
harvest
20+ sites
email FTP
OCLC Capabilities
• Harvesting
• OAI-PMH versions 1.1 and 2.0
• Harvestable sets
• Sets by institution
• Searching
• SRU (Z39.50 on the Web)
• VTLS
• Virginia Tech Open Digital Library demo
• Unicode support
OCLC Statistics
• 19 Sources
• 61,998 records
• Probably some overlap
• Adding 1-2 new sites/month
Multiple objectives
• Sharing research results
• Decrease costs, increase services
• Increase knowledge of users
• Adding to author knowledge/skills
• Epub, DL, IPR
• Enhancing organization’s infrastructure
• CS department, library
• University, Laboratory
Some Barriers at Universities
•
•
•
•
Lethargy; Not invented here (esp. large univ’s)
Anger with unfunded, added, required work
Last straw: using more frustrating technology
Lack of experience in working together:
graduate school, library, computing staff
• Lack of interest in (quality of) student work
• More loyalty to discipline than to campus
• Unwillingness to accept responsibility for $
problems with libraries, publishers
How can a university get
involved?
• Select planning/implementation team
•
•
•
•
Graduate School
Library
Computing / Information Technology
Institutional Research / Educ. Tech.
• Fill in online form, giving us contact names
• www.ndltd.org/join
• Adapt Virginia Tech (or other) solution
• Build interest and consensus
• Start trial / allow optional submission
Contact Our Project Team
Video Tape
E-mail
etd@ndltd.org
Phone Call
Visit
Convene Local Planning Group
ETD
Build Local ETD Site
ETD
Workshop/Training
Digital Library
Policies
Inspection/Approval
Support Offered
•
•
•
•
Software, documentation, tech support
Email, listservs (etd-l@listserv.vt.edu)
UNESCO training, Guide (www.etdguide.org)
NDLTD Committees
• Conference
• Membership
• Software Distribution
• Standards
Why ETD?
Short Answer
• For Students:
• Gain knowledge and skills for the Information Age
• Richer communication (digital information, multimedia, …)
• For Universities:
• Easy way to enter the digital library field and benefit thereby
• For the World:
• Global digital library – large, useful, many services
• General:
• Save time and money
• Increased visibility for all associated with research results
The Process?
Short Answer
• For Students:
• Plan on ETD from day 1
• Secure knowledge from: workshops, online info, colleagues
• Work with faculty to plan approach
• PDF? XML? TEI? Multi/hypermedia? Data sets? Viz?
• Get signed approval form: access, ©, proxy assignment
• After defense and approval, submit ETD to university
• For Universities:
• Form team
• Adapt solution from work at other universities, attend ETD
conference
• Pilot -> Option -> Requirement
Future Work - 1 of 2
• Working with publishers to increase level of access
as much as possible -> joint awards
• Interoperability tests to provide integrated services
• Study with testbed that emerges, to improve
information retrieval, browsing, interface, and other
types of user support
• Evaluation, improving learning experience, spread
further as worldwide initiative, sustainable support
and coordination
Future Work - 2 of 2
• Adding services currently prototyped
• annotation and SDI (routing) capabilities
• fulltext search, crawling
• Adding other services planned
• building and using citation database (w. SFX)
• implementing plagiarism check (like “SCAM”)
• Further development of NDLTD Inc. as nonprofit
charitable educational institution promoting
education and digital libraries
Spirit of NDLTD
•
•
•
•
•
Help make a better (smaller) world
Win-win-win (everyone can benefit)
Have fun helping others
Helpers/teachers learn more than those they work with
Cooperation, friendly competition
• When you “1-up” VT, share your software, documents!
• “Doing better” requires both “doing”, “better”
• Balance (and build on standards)
• New, popular, powerful, expressive, exciting, “better”
• Doable, feasible, learnable, affordable, sharable, preservable
• We can always do more, enhancing quality and
knowledge!
Outline
•
•
•
•
•
•
•
•
•
Virginia Tech context
Why DLs? What are DLs? (5S theory)
Case Study: CSTC -> CITIDEL-> NSDL
Case Study: NDLTD
Accessibility and Visualization
DL Software: MARIAN
Interoperability: OAI, ODL
Topical Outline
Selected Links
Portals and DLs
• Reengineering PhysNet in the uPortal framework by
Ye Zhou (Dept. of Computer Science, MS thesis,
Virginia Tech, May 2003). Hypothesis:
• DLs can be modeled as a set of interactive and noninteractive components with well-defined intercomponent communication protocols.
• Offering a customizable User Interface (UI) toolkit
can facilitate the process to build a DL.
• Distributed DL services can be achieved with the
enablement of a web service on each individual
component.
• To prove the hypothesis above, we designed,
implemented, and tested a framework in a portal
reengineering project.
PhysNet Re-engineering
PhysNet Re-Engineering
• Screen shot
New Services: PACS Recommender
Browse user interface with uPortal
Browse user interface with uPortal – cont’d
uPortal project,
http://www.udel.edu/uportal/
Weiner, K., “Introduction to uPortal
2.1”, JA-SIG Conference, Dec. 2002
Accessibility Activities / Plans
•
•
•
•
•
Interface design (simple, 3D, VR)
Usability studies
Generic multi-lingual support
Support for those with disabilities
Hybrid collection (paper, MARC,
abstracts, full-text, multimedia)
• Disciplinary classifications, tools
• Visualization of results, collection
CAVE Experiments
• Use a familiar metaphor
• building / floor / room / shelf / book
• Rearrange orderings / shelving
• use categories, clustering, ranking
• use visualization: colors and gaps
• study space mappings: physical, logical
• Simplify movement for key tasks
CAVE-ETD
• CAVE-ETD is a simulation of a library that
runs in a CAVE (VR environment).
• Populated with a subset of ETD records.
room
room
room
room
Main
Foyer
Book Browsing
Reading Book Abstract
ENVISION
• NSF “A User-Centered Database from the Computer
Science Literature” (1991-93)
• Collected bib/typesetter data, converted to SGML
• Scanned thousands of page images
• MARIAN search engine - can be made available (also
applied to the Virginia Tech library catalog) used as part
of a prototype object-based DL, with tailored
visualization interface (L. Nowell dissertation)
Envision Results Window
Envision – New Version
Envision – New Versions - Clusters
SPIRE Visualization
VIDI:
A Lightweight Protocol Between
Visualization Systems and
Digital Libraries
Jun Wang
Virginia Tech CS MS Thesis
Spring 2002
Problem Concerned
• Scenario
DL1
DL2
VIS1
DL3
VIS2
VIDI Protocol Design Features
•
•
•
•
•
•
•
•
•
Enabling interoperability
Lightweight
Extended OAI Protocol
Flexible implementations enabled
General
XML, HTTP
Standard time formats
Dual usage of commands
Simple and Easy!
VIDI Protocol Request Verbs
•
•
•
•
•
Identify (DL, VIS)
ListMetadataFormats (DL)
ListVisdataFormats (VIS)
ListTransformers (VIS)
RequestResultSet (DL)
Extend OAI Protocol
OAI
•GetRecord
•ListIdentifiers
•ListRecords
•ListSets
OAI & VIDI
•Identify
•ListMetadataFormats
VIDI
•ListVisdataFormats
•ListTransformers
•RequestResultSet
Implementation Roles and Times
• Implementing protocol
• Devising general approaches to protocol use
for DL-VIS environments
• Applying protocol in representative cases
• ENVISION-ODL
• ENVISION-MARIAN
Implementation Process
1.
2.
3.
4.
5.
Analyze metadata format in DL
Analyze visdata format in VIS
Write transformer (if not in registry)
Decide on command flow
Implement protocol commands
Command Flow Used In Prototype
<back
ENVISION-ODL (II)
Connect ENVISION with:
• ODL
A DL implementing OAI protocol, which
means we can issue OAI requests and receive
responses to retrieve the data
ENVISION-MARIAN
Connect ENVISION with:
• MARIAN
• A DL having multiple collections (NDLTD,
DIRLINE, CITIDEL, VT catalog,…)
• User Authentication
Future Work
• SOM decoupling
DL
VIS
Transformer
Outline
•
•
•
•
•
•
•
•
•
Virginia Tech context
Why DLs? What are DLs? (5S theory)
Case Study: CSTC -> CITIDEL-> NSDL
Case Study: NDLTD
Accessibility and Visualization
DL Software: MARIAN
Interoperability: OAI, ODL
Topical Outline
Selected Links
MARIAN
• Multiple Access Retrieval of Information with
Annotations
• (Marian the Librarian …)
• Evolved from CODER system to a distributed
Online Public Access Catalog (OPAC), then DL
backend, now becoming a full DL system
• From C/C++ to Java
• Future: NDLTD, NUDL, PetaPlex
• Use for campus collection management
• Use for www.theses.org as centralized system
with gateway services: OAi, Harvest, Z39.50, …
MARIAN
• Digital Library Search & Retrieval System
• Principles
• Network representation
• Class-based retrieval
• Weight-valued functions and weighted sets
• Interoperability
• System: wrappers and harvesting
• Syntax: OAI standards (XML, Unicode, …)
• Structure: information networks
• Semantics: class-based retrieval
: collection views
MARIAN Layers
User
User
User
User Interface Layer
User Information Layer
Search Engine Layer
Database Layer
User
MARIAN Architecture
System & Syntactic Interoperability
Search Services
Recommendation Services, etc
Analysis
Indexing
Linking
5SL
Source
Description
NDLTD/NUDL/Digital
Library User
MARIAN Mediation Middleware
Local Data Store
Wrapper
Generator
Queries + Results
wrapper
wrapper
Dublin
Core
SOIF
Harvest
protocol
German
PhysDis
Collection
...
Collection
wrapper
MARC
Open Archives
protocol
VT OAI
wrapper
Z39.50
protocol
...
RFC1807
Dienst
protocol
Greek
Hellenic Dissertations
Collection
MIT ETD
Collection
MARIAN – Part of Class Hierarchy
Structural Interoperability
through Information Networks
Phy sDis-ETD
DC.Creator
Individual
DC.Title
Individual
MIT-ETD
CrawlerTitle
Title
Subject
DC.Description
DC.Subject
Key word Set
CrawlerDescription
Headings
Body
(RFC1807 Format)
Key word Set
(S OIF Format)
Person
Corporation
VT-ETD
VT-ETD
Person
Title
Conference
Title
Notes
Composite Subject
Abstract
Subject
Subject Entry
(ETD-MS Format)
(MARC-21 Format)
PhysDis Collection View
Individual
ThesisDissertation
HasAuthor
Ti t le
Subc lasses
Descrip tio n
0 .8
HasSub ject
Subc lasses
0 .8
1 .0
1 .0
Subc lasses
1 .0
0 .9
Subject
0 .8
1 .0
0 .8
0 .9
DC.Creator
Phy sDis-ETD
HasDcCreator
DC.T i tl e
Individual
HasCra wler Author
Crawler Ti tl e
DC.Descr ip t io n
HasDcSubject
DC.Subject
CrawlerDescr ip tio n
HasHeadings
Headings
Bo d y
HasKeywords
Key word Set
MARIAN Parallelism
response time
(ms)
Java part response time vs. query rate comparation
(type 1 requests)
4000
3000
2000
1000
0
0
100
200
300
queryrate (#/min)
all modules in one machine
one "webgate"
two "webgate"s
four "webgate"s
400
500
Outline
•
•
•
•
•
•
•
•
•
Virginia Tech context
Why DLs? What are DLs? (5S theory)
Case Study: CSTC -> CITIDEL-> NSDL
Case Study: NDLTD
Accessibility and Visualization
DL Software: MARIAN
Interoperability: OAI, ODL
Topical Outline
Selected Links
Open Archives Initiative
OAI
www.openarchives.org
openarchives@openarchives.org
OAi Philosophy
•
•
•
•
•
Self-archiving = submission mechanism
Long-term storage system = archive
Open interface = harvesting mechanism
Data provider + service provider
Start with “gray literature”
• e-prints/pre-prints, reports, dissertations, …
Open Archives Initiative (OAI)
•
•
•
•
xxx@LANL, high-energy physics (Ginsparg, 1991)
CSTR + WATERS = NCSTRL (Lagoze,1994)
xxx + NCSTRL = CoRR collaboration (1998)
Universal Preprint Service protoproto, Oct. 21-22, 1999,
Santa Fe – led by LANL, CNI, DLF, Mellon --> OAi
• Santa Fe Convention (see Feb. D-Lib Magazine article)
• Follow-on mtgs: 6/3@San Antonio, 9/21@Lisbon (ECDL)
• Archives -> Open Archives
•
•
•
•
Support unique archive identifiers
Implement Open Archives metadata set (DC, using XML)
Implement OA harvesting protocol (derived from Dienst protocol)
Register the archive
• Build tools, layer other services: linking, searching, …
Open Archives (protoproto)
•
•
•
•
•
•
•
ArXiv & Los Alamos National Lab
CogPrints & U. Southampton
NACA & NASA (reports)
NCSTRL & Cornell U.
NDLTD & Virginia Tech
RePEc & U. Surrey
Total of around 200K records
Original Open Archives Members
•
•
•
•
•
•
•
•
•
American Physical Society
California Digital Library
Caltech
Coalition for Networked Info.
Cornell University
Harvard University
Library of Congress
Los Alamos Nat’l Lab
Mellon Foundation
•
•
•
•
•
•
•
•
•
NASA Langley Research Cntr
Old Dominion University
Stanford University
U. of Ghent
U. of Surrey
U. of Southampton
Vanderbilt University
Virginia Tech
Washington University
Open Archives Future
•
•
•
•
•
•
•
•
•
EconWPA (U. Washington)
e-biomed -> PubMed Central (NIH)
PubScience (DOE)
Clinical Medicine Netprints (+ other HighWire Press
holdings )
University ePub (California Digital Library)
All public e-prints (MIT)
Scholar’s Forum (Caltech)
Int’l: CERN, Germany, India, Mexico, …
Goal: millions of books/articles/reports / yr
Harvesting vs. Federation
• Competing approaches to interoperability
• Federation is when services are run remotely on remote
data (e.g. Federated searching)
• Harvesting is when data/metadata is transferred from
the remote source to the destination where the services
are located (e.g. Union catalogues)
• Federation requires more effort at each remote
source but is easier for the local system and vice
versa for harvesting
• OAI currently focuses on harvesting
Metadata vs. Data
• Data refers to digital objects or digital
representations of objects
• Metadata is information about the objects
(e.g. title, author, etc.)
• OAI focuses on metadata, with the implicit
understanding that metadata usually
contains useful links to the source digital
objects
Technical Umbrella for Practical
Interoperability…
Reference
Libraries
Museums
Publishers
E-Print
Archives
…that can be exploited by different communities
OAI – Repository Perspective
Required: Protocol
MDO
MDO
MDO
MDO
MDO
MDO
MDO
MDO
DO
DO
DO
DO
OAI – Black Box Perspective
OA 7
OA 4
OA 2
OA 1
OA 3
OA 6
OA 5
OAI – Black Box Perspective
Services:
Search
Browse
Metadata:
Summarize
Visualize
OA 7
OA 4
OA 2
OA 3
OA 1
OA 6
OA 5
Docs:
DO
DO
DO
DO
DO
DO
DO
Aggregation through
OAI Harvesting
CITIDEL
NCSTRL
Lite Sites
Archive
Eprints
Active
Own: History,
ResearchIndex,
CSTC, …
IEEE-CS,
ACM, …
Tiered Model of Interoperability
Mediator services
Metadata harvesting
Document models
Repository of Digital Objects
Repository
Access
Protocol
handle
terms and conditions
Digital object
Approaches to Open Archives
Build By Institution
Build By
Discipline
Approaches to Open Archives
Build By Institution
Build By
Discipline
Author
Category
Interdisciplinary
Year
Language
Query …
Author′s tools
www.physik.uni-oldenburg.de/EPS/mmm
The World According to OAI
Service Providers
Discovery
Current
Awareness
Data Providers
Preservation
Figure 1. Layers Related to Open Archives Initiative
Services
Citation /
Linking
Authoring
Submission
SFX
Editorial:
CiteSeer
Reviewing,
Certification
Summarization
Metadata
Creation
Registry
Citation
Checking
Archives:
Text/MM
Editing
Citation DB
Updating
Name, ID,
Description,
Terms and
Conditions,
…
Authority
Control
Preservation
Conversion
Metadata Formats:
Gazetteer
Cataloging
Copy-Edit / Add Value
Name,
Standard,
Preservation
Process, …
Name, XML DTD, …
Search/Browse
Protocols
Annotation
Collaboration
Archive
Formats:
…
Services
Tools
…
Repository
Repository for NDLTD
Metadata Formats:
OA Metadata Set,
NDLTD Standard
(DC-based) Set
Transaction Log
Training Resources
Open Archives Harvesting Protocol
VT Partition
Record
(Metadata)
Record (Full
Content)
NCSTRL
Repository
UVA Partition
Metadata
…
Content
…
EconWPA
Repository
…
Caltech Partition
Metadata
Content
RePEc
Repository
Mechanisms
• Sharing
• Join federation, run software
• Make metadata and archive available
• Aggregating
• By discipline
• By institution
• By genre
• Automating
•
•
•
•
Workflow
Harvesting and providing services
Federated searching
Dynamic linking (e.g., with SFX (OpenURLs))
VT View of the
Open Archives Initiative (OAI)
• Enable sharing of publication metadata and fulltext by digital libraries
• Standardize low-level mechanisms to share
contents of libraries
• Build higher-level user-centric and administrative
services in meta-libraries
• Install organizational mechanisms to support the
technical processes
• Insights from 5S (streams, structures, scenarios)
Virginia Tech Projects
• MARC XML-DTD
• Computer Science Teaching Centre (CSTC)
• W3C Web Characterization Repository
• OAI Repository Explorer
• NDLTD
• Open Digital Libraries, XOAI-PMH
MARC XML-DTD
• XML Transport format for US-MARC
records
• Standardized metadata exchange format
for traditional library services joining OAI
Protocol for Metadata Harvesting
• Service Requests
•
•
•
•
•
•
•
•
•
•
Identify
ListMetadataFormats
ListSets
GetRecord
ListIdentifiers
ListRecords
Metadata Multiplicity
Date/Time Ranges
Sets (with semantics depending on local data providers)
Resumption Tokens
Key Features of the OAI
Metadata Harvesting Protocol
• definitions &
concepts
• repository
• record
• identifier
• datestamp
• set
• protocol features
• HTTP encoding
• metadata prefix &
schema
• flow control
• protocol requests
• supporting requests
• harvesting requests
repository
support
data
harvesting
data
h
a
r
v
e
s
t
e
r
OAI protocol
r
e
p
o
s
i
t
o
r
y
items
identifiers
locally unique key for extracting a record
from a repository
oai-identifier = oai:archive-identifier:record-identifier
Registered
URI
Scheme
Archive Identifier:
Registered within
OAI
Unique ID within
archive:
(syntax is archivespecific)
example = oai:ncstrl:ncstrl.cornellcs/TR94-1418
selective harvesting - datestamps
harvest within
date range
record
record
r
e
p
o
s
i
t
o
r
y
selective harvesting - sets
harvest within set
record
record
record
r
e
p
o
s
i
t
o
r
y
S1
S2
OAI Tools
•
•
•
•
Related resources, e.g., XML, Unicode
Servers and utilities, e.g., ARC, Kepler, EPrints
XML Schema Validator
Repository Explorer
•
•
•
•
•
Interactive Browsing
Testing of parameters
Multiple views of data
Multilingual support
Automatic test suite
ARC (arc.cs.odu.edu)
Kepler Architecture
User
4. Query
arc
Service Provider
Service Provider
2. Data provider locate
5. Full Text fetch
3. Metadata Harvest
Registration Server
mapping
table
DP handle IP:Port Active
DP handle IP:Port Active
1. Register/Notify
HTTP (Only Supports OAI request)
OAI Layer
File based Repository Personal Editor
Archivelet
archivelet
archivelet
OAI-based NCSTRL architecture
XSV Schema Validator
OAI Repository Explorer
• Serves as a compliancy test
• Allows browsing of open archives using only OAI
protocol
• Sends requests on behalf of user, parses and checks
responses and displays browsable interface
• Will detect most discrepancies in protocol
• http://purl.org/net/explorer
RE
1.3
OAI Repository Explorer
• Serves as a compliancy test
• Allows browsing of open archives using only OAI
protocol
• Sends requests on behalf of user, parses and checks
responses and displays browsable interface
• Will detect most discrepancies in protocol
• http://purl.org/net/explorer
Request, Response – OAI, VT ETDs
Request
http://scholar.lib.vt.edu/theses/OAI/cgi-bin/index.pl?
verb=GetRecord&metadataPrefix=oai_etdms&identifier=oai:VTETD:etd-520112859651791
Response
Case Study: NCSTRL Costs/Benefits
Stakeholders
Sample Potential Cost
Sample Potential Benefit
Providers
Faculty
Lower value for P&T
Faster publishing
Students
Less recognition
Broader set of outlets
Practitioners
Limited relevance
Ease of publishing, > quantity
Faculty
Lower quality of work
Broader access to resources
Students
Higher access costs (vs.
department available
material)
Lower access costs (vs. journal
available material)
Departments
New maintenance costs
Broader visibility
University libraries
Additional access costs
Access to new resources
Practitioners
More difficult access
Access to new resources
Users
The OAI Static Repository Model
• Components of the model
• The static repository
• An well-defined structure XML file with
information similar to that in OAI-PMH responses
• Accessible at a persistent network-location
• The static repository gateway
• makes one or more Static Repositories harvestable.
• assigns a unique base URL to each such Static
Repository
• Responding to OAI-PMH requests
The OAI Static Repository Model
DL Components
Gateways
MM/ HT Renderer
User Interfaces
Workflow Mgr
Search Engines, Classifiers, …
DBMS
Rights Mgr
Data, MM Info
Repository
Open Digital Library (ODL)
Hypothesis (Hussein Suleman)
• Can we leverage the successful model of the OAI
Protocol for Metadata Harvesting to alleviate our
architectural problems ?
Maybe … if
Digital Libraries can be modeled as
• networks of extended Open Archives, where
• each extended Open Archive is a
• source of data and/or a provider of services.
Open Digital Libraries
XOAI-PMH
• Dissertation work of Hussein Suleman
(member of OAI technical committee)
• Extending the OAI protocol
• Supporting rapid development of DLs using
networks of components
• Demonstrated with NDLTD, CSTC
• Described in Dec. 2001 D-Lib Magazine
article, and article submitted for publication
Document
Document
Document
1010100101
?
1010100101
0100101010
1010100101
0100101010
1001010101
0100101010
1001010101
0101010101
1001010101
0101010101
0101010101
Video
Video
Video
1010100101
1010100101
0100101010
1010100101
0100101010
1001010101
0100101010
1001010101
0101010101
1001010101
0101010101
0101010101
users
Program
Program
Program
1010100101
1010100101
0100101010
1010100101
0100101010
1001010101
0100101010
1001010101
0101010101
1001010101
0101010101
0101010101
Image
Image
Image
1010100101
1010100101
0100101010
1010100101
0100101010
1001010101
0100101010
1001010101
0101010101
1001010101
0101010101
0101010101
digital objects
?
?
Document
Document
Document
1010100101
1010100101
0100101010
1010100101
0100101010
1001010101
0100101010
1001010101
0101010101
1001010101
0101010101
0101010101
?
?
?
?
?
?
?
?
?
?
?
?
?
?
?
?
Image
Image
Image
1010100101
1010100101
0100101010
1010100101
0100101010
1001010101
0100101010
1001010101
0101010101
1001010101
0101010101
0101010101
?
?
?
componentized digital library
Program
Program
Program
1010100101
1010100101
0100101010
1010100101
0100101010
1001010101
0100101010
1001010101
0101010101
1001010101
0101010101
0101010101
?
Video
Video
Video
1010100101
1010100101
0100101010
1010100101
0100101010
1001010101
0100101010
1001010101
0101010101
1001010101
0101010101
0101010101
XPMH
Document
Document
Document
1010100101
1010100101
0100101010
1010100101
0100101010
1001010101
0100101010
1001010101
0101010101
1001010101
0101010101
0101010101
OA
OA
XPMH
XPMH
OA
OA
XPMH
XPMH
XPMH
XPMH
OA
PMH
XPMH
OA
XPMH
OA
OA
XPMH
OA
XPMH
open digital library
PMH
Program
Program
Program
1010100101
1010100101
0100101010
1010100101
0100101010
1001010101
0100101010
1001010101
0101010101
1001010101
0101010101
0101010101
Image
Image
Image
1010100101
1010100101
0100101010
1010100101
0100101010
1001010101
0100101010
1001010101
0101010101
1001010101
0101010101
0101010101
Video
Video
Video
1010100101
1010100101
0100101010
1010100101
0100101010
1001010101
0100101010
1001010101
0101010101
1001010101
0101010101
0101010101
Component System Approach
• (Open) DL = Network of Extended OAs
Data Input
Local Archive
Resource Discovery
Search
Browse
Recommend
Metadata Repository
legend
Remote Archive
User Interface
OAI/ODL archive
OAI/ODL protocol
Example Architecture (NDLTD)
Virginia Tech
User Interface
PhysNet
Humboldt
Search
Browse
Recent
Duisburg
CalTech
Union Catalog
MIT Filter
MIT
legend
Dresden
User Interface
OAI/ODL archive
OAI/ODL protocol
ODL Demonstration - FrontPage
ODL Demonstration - Search
ODL Demonstration - Browse
ODL Component Requirements
• Search
• Retrieve a list of items
• Index new items
• Annotate
• Add annotation to item
• Retrieve a list of annotations for an item
Open Digital Library Components
• Running now
• XML-File (data provider from file system)
• Union, search, browse, recent, filter
• E-journal/review, Submit, Edit, Annotation
• Class projects
• High performance multilingual search
• Recommender, Rating; Mirroring (see JCDL’02)
• Working with NCSA: from DB, unstructured text
• Others discussed
• Classification/categorization
• DL-Viz interconnection (VIDI – Jun Wang ETD)
Open Digital Library: Extended
As What’s
New Service
Provider
What’s
New
Engine
XML File
Coll. & Data
Provider 1
XML File
Coll. & Data
Provider 2
XML File
Coll. & Data
Provider 3
As Metadata
Search Service
Provider
IRDB-1
Search
Engine
As Metadata
Browse Service
Provider
DBBrowse
Browse
Engine
As Recommend
& Rate Service
Provider
Recommend
Rate
Engine
DBUnion Archive Merger Component
Harvest from
As Annotation
Search Service
Provider
Annotation
Engine
data providers
Filter
OAI-PMH
Data Provider
Submit
Archive
IRDB-2
Search
Engine
OAIB (NCSA:
from RDBMS)
Example Open Digital Library
ODLRecent
Document
Document
ETD-1
1010100101
1010100101
0100101010
1010100101
0100101010
1001010101
0100101010
1001010101
0101010101
1001010101
0101010101
0101010101
Recent
USER INTERFACE
Students and
researchers
ODLUnion
PMH
Filter
PMH
ODLUnion
Browse
Union
PMH
ODLBrowse
ODLUnion
Search
ODLSearch
Program
Program
ETD-2
1010100101
1010100101
0100101010
1010100101
0100101010
1001010101
0100101010
1001010101
0101010101
1001010101
0101010101
0101010101
PMH
Filter
PMH
Image
Image
ETD-3
1010100101
1010100101
0100101010
1010100101
0100101010
1001010101
0100101010
1001010101
0101010101
1001010101
0101010101
0101010101
Video
Video
ETD-4
1010100101
1010100101
0100101010
1010100101
0100101010
1001010101
0100101010
1001010101
0101010101
1001010101
0101010101
0101010101
Digital Library for the Networked Digital Library
of Theses and Dissertations (www.ndltd.org)
ETD collections
Example Open Digital Library
USER INTERFACE
Box:
Users
Box:
Reviews
DBReview
Box:
Accepted
Resources
Box:
Resources
under Review
Thread
DBRate
Suggest
DBUnion:
Metadata
Union
User Interface
OAI/ODL component
OAI/ODL protocol
IRDB
DBBrowse
DBUnion:
Legacy
Metadata
Digital Library for the
Computer Science Teaching Center (www.cstc.org)
Digital Library in a Box
• Domain: helping DL projects
• Genre: any domain, but especially those
involved in NSDL (since funded in part
is through NSDL – with U. FL, NCSA)
• Software and Documentation:
http://dlbox.nudl.org
Outline
•
•
•
•
•
•
•
•
•
Virginia Tech context
Why DLs? What are DLs? (5S theory)
Case Study: CSTC -> CITIDEL-> NSDL
Case Study: NDLTD
Accessibility and Visualization
DL Software: MARIAN
Interoperability: OAI, ODL
Topical Outline
Selected Links
Topical Outline:
Digital Library Courseware
• http://ei.cs.vt.edu/~dlib/
• WWW pages or large PDF copy files
• Online quizzes based on book by Michael Lesk
(Morgan Kaufmann Publishers)
• Contents based on book, with several other
popular topics added (e.g., agents)
• Separate pages to supplement: Definitions,
Resources (People, Projects), and References
Topical Outline - Foundations
•
•
•
•
•
Early visions
Definitions
Resources
References
Projects
Topical Outline - Foundations
• Early visions:
• “a device in which an individual stores all
his books, records, and communications,
and which is mechanized so that it may be
consulted with exceeding speed and
flexibility” - Bush, V., “As We May
Think”, Atlantic Monthly, 176(1):101-108,
Jul. 1945
Topical Outline - Foundations
• Definitions:
• A digital Library (DL) can be described as an
electronic information storage system focused
on meeting the information seeking needs of its
users. - Levy, D., and Marshall, C. C., “Going
Digital: A Look at Assumptions Underlying
Digital Libraries”, Communications of the
ACM, 38(4):78-84, 1995.
Topical Outline - Foundations
• Definitions:
• Association for Research Libraries,
http://sunsite.berkeley.edu/ARL/definition.html:
• The digital library is not a single entity.
• The digital library requires technology to link the
resources of many.
• The linkages between the many digital libraries and
information services are transparent to the end users.
• Universal access to digital libraries and information
services is a goal.
Topical Outline - Foundations
• Definitions:
• Digital libraries are organizations that provide the
resources, including the specialized staff, to select,
structure, offer intellectual access to, interpret,
distribute, preserve the integrity of, and ensure the
persistence over time of collections of digital works so
that they are readily and economically available for use
by a defined community or set of communities - Digital
Library Federation, “A Working Definition of Digital
Library”, Apr. 1999.
http://www.clir.org/diglib/dldefinition.htm
Topical Outline - Foundations
• Definitions:
• A library that maintains all, or a substantial part, of its
collection in computer accessible form as an
alternative, supplement, or complement to the
conventional printed and microfilm materials that
currently dominate library collections. Used in this
context, the term "collection" denotes the documents
that a library acquires or maintains - Saffady, W.,
“Digital Library Concepts and Technologies for the
Management of Library Collections: An Analysis of
Methods and Costs”, Library Technology Reports
31.3:221-380, 1995
Topical Outline – IR Areas
•
•
•
•
•
•
•
•
Search, Retrieval, Resource Discovery
Information storage and retrieval
Boolean vs. natural language
Search engines
Indexing, phrases, thesauri, concepts
Federated search and harvesting, OAI
Integrating links and ratings
Crawlers, spiders, metasearch, fusion
• Details following – Li Wang indep. study
Logical View of Document + Indexing
from
Baeza-Yates, R., and Ribeiro-Neto, B.,
Modern Information Retrieval, Addison Wesley, 1999
Retrieval Process
from Baeza-Yates, R., and Ribeiro-Neto, B.,
Modern Information Retrieval, Addison Wesley, 1999
PACS Automatic Classification
Classification
Servlet
Selector
Classifier
Trained
Model
Classification
Scheme
Classifier
Trained
Model
Classification
Scheme
J2EE Server Container
PACS Automatic Classification
Online
What is a Crawler?
•
•
•
•
•
•
A Program
An Important Module For Web Search Engine
Crawls On The Web According To Its Algorithm
Retrieves Web Pages
Gets Useful Information
Stores The Web Pages For Future Refining
Jobs For Threads
Get A New URL
From Buffer
Put New URLs
Into Buffer
Contact The Server
For File Type
Parse The
Web Page
Download The
File
Advanced Functions
• Backward Linkage Information Collector
A Web Page
Topical Outline - Multimedia
•
•
•
•
•
•
Multiple media types, representations
Text, audio, image, video, graphics, animation
Capture, digitization, standards, interchange
Compression, content-based retrieval
Playback (Real), SMIL, QoS
JPEG, MPEG (and versions)
Document Models,
Representations, and Accesses
• Doc = stream + structure + use-scenario; hybrid
(paper/electronic), digital only
• Multilingual: content, summary, metadata
• Multimedia: structure, quality (oS), search
• Structured: MARC, SGML, by user: MVD
• Distributed collection: Kleisli, CIMI, Z39.50
• Federated search: collecting, picking site(s),
parallel search / fall-back, fusing results
• Access: IPR, payment, security, scenarios
Topical Outline - Architectures
•
•
•
•
•
•
Distributed, centralized
Modular, componentized
Bus (InfoBus), hierarchical, star
Mediators, wrappers (TSIMMIS)
Light weight protocols
Architecture of OAI and XOAI
Architectural Issues
• Internet middleware
• Independent system / part of federation
• Decompositions vary
• search engine, browser, DBMS, MM support
• repository, handle server, client
• information resources + mediators, bus or agent
collection + client with workspace/environment
• Metrics: e.g., for federated search
Sornil & Mather Dissertations
• Mather: efficiently handling very large numbers
of objects of varying sizes
• Sornil: efficiently handling IR for very large
dynamic collections, large numbers of users,
high transaction rates, large inverted files
• modeling and simulation
• data organization
• parallelization of algorithms, alone and in
combination for retrieval (related) tasks
OAI and I2-DSI (Ryan Richardson)
•OAI – metadata harvesting
•OAI-PMH
•Data providers/Service providers
•I2-DSI – mirroring and replication
•Can we put them together to get benefits of both?
•Is this the first of many higher level mirroring
schemes for Internet2, that provide independence
from lower level representation issues?
I2-DSI interface
I2-DSI Architectural Diagram
OAI Server
Mirror
Mirror
Mirror
Internet
Distributed
Director
User
Mirror
I2-DSI Technical Issues
• Resumption tokens
• Mirrors are stateless, so any mirror can answer (any part of)
a request
• Every client request to the mirror is logged, to enable
log comparison among the mirror archives
• Mirroring time is dependent on # of records sent in
each chunk
• Can we connect this or something similar with
LOCKSS (lots of copies keep stuff safe)
Topical Outline – Interfaces
•
•
•
•
•
•
Taxonomy of interface components
Workflow
Visualization
Environments
Design
Usability testing
Topical Outline – Metadata
•
•
•
•
•
•
•
•
MARC
Dublin Core
RDF
IMS
OAI (Open Archives Initiative)
Crosswalks, mappings
Ontologies
Topics maps, concept maps
Automatic Generation of Concept Maps
Ryan Richardson, Rao Shen
 Concept maps are a valuable pedagogical tool (Novek
& Gowin, 1984)
 Are concept maps a good summarization tool?
 Answer: Yes, they are at least a good supplement to
abstracts, according to an experiment we did last
semester
 Unfortunately, making concept maps by hand is
tedious for more than a few documents
 Can we generate useful concept maps automatically,
for both English and Spanish documents?
Generation by term co-occurrence
 Procedure for Spanish documents
 Determine part-of-speech for each word
 Collapse all inflected forms to root form
 Concatenate noun phrases into one “concept”
 Remove some stopwords; others are crosslinks
 Future: Use synonym sets to further collapse words
 Use Agrawal’s algorithm for association rules to find
related concepts
 Can translate node/link labels into English
automatically, if desired
Automatically generated concept map
This map was
extracted from a
Spanish essay on
“Cien Años de
Soledad” (100
Years of Solitude)
References
• Background: http://cmap.coginst.uwf.edu/info/
• GetSmart:
http://ai8.bpa.arizona.edu:8080/aicm/index.html
http://ai.bpa.arizona.edu/go/mlir/
• Agrawal's association rules algorithm:
http://citeseer.nj.nec.com/agrawal94fast.html
• Gaines and Shaw:
http://ksi.cpsc.ucalgary.ca/articles/ConceptMaps/
CM.html
• Japanese Work:
http://www.icce2001.org/cd/pdf/P06/JP031.pdf
• Singapore work:
http://textmining.krdl.org.sg/people/kanagasa
Topical Outline – Epub, SGML, XML
•
•
•
•
•
•
•
•
Authoring
Rendering, presenting
Structure
Tagging, Markup, DOM
Semi-structured information
Dual-publishing, eBooks
Styles (XSL, XSLT)
Structure queries
Topical Outline – Databases
•
•
•
•
•
•
Extending database technology
Structured and unstructured info
Multimedia databases
Link databases
Performance
Replicated storage, I2-DSI (details following)
Topical Outline – Agents
•
•
•
•
•
•
Protocols
Knowledge interchange
Negotiation, registries
Distributed issues
Ontologies (standard upper)
Webbots (automatic indexing)
Topical Outline – Economics
• E-commerce
• Sustainability
• Preservation and archiving
• DLF, Besser, Lorie, Gladney
• Self-archiving
• Open collections
• Economic models, business plans
Topical Outline – IPR
•
•
•
•
•
•
•
Intellectual property rights (IPR)
Legal issues
Terms and conditions
Copyright
Patents, trademarks
Distributed rights management
Security
Topical Outline – Social Issues
•
•
•
•
•
•
•
•
•
Cooperation, collaboration
Annotation, ratings
Digital divide
Educational applications
Cultural heritage
Museums (AMICO)
Organizational acceptance
Personalization
Internationalization
Social Capital?
• Increase local interchange among students,
faculty, library, graduate school
• Increase international understanding,
building many more invisible colleges,
with students more empowered
• Connect graduate researchers with
undergrads, who can access ETDs / them
• Facilitate direct university collaboration,
explicitly, in reshaping publishing world
Collaborative
Development
(Joan Lippincott)
Why Collaboration?
• Expertise in aspects of the digital
environment
• Pooling of resources
Collaboration and digital projects
•
•
•
•
•
Distributed systems
Digital course content
Digital library resources
Delivery of services
Development of policies
Collaborations involve:
• Shared goals
• Common vision
• Shared vocabulary
Two views of an ETD progam
• Have staff scan
• Implement now
• Increase
university
visibility
• Teach students to
write and submit
ETDs
• Implement soon
• Develop electronic
authors
In a collaboration...
• Each contributes resources
• Partners acknowledge and value
contributions
• Partners develop a clear process
• Group and individual accountability
ETD project participants
•
•
•
•
•
•
•
Academic administrators
Faculty
Students
Staff
Graduate school / provost / registrar
Information technologists
Librarians
Collaboration and NDLTD
• Common goals of members
• Diverse sets of skills and expertise
• Need for strategies and tactics to
surmount any problems -> advocacy
Collaborative project strategy
• Champion initiates project
• Leadership establishes initial goal and
parameters
• Issue a call for participants
• Conduct procedure to select
participants
Collaborative project strategy
• Initial meeting
• Develop shared goals
• Develop clear process
• Continue work at institutions
• Establish communication channels
• Establish project milestones
• Evaluate progress, refine approach
Outline
•
•
•
•
•
•
•
•
•
Virginia Tech context
Why DLs? What are DLs? (5S theory)
Case Study: CSTC -> CITIDEL-> NSDL
Case Study: NDLTD
Accessibility and Visualization
DL Software: MARIAN
Interoperability: OAI, ODL
Topical Outline
Selected Links
Selected Links - http://fox.cs.vt.edu
• CITIDEL
• www.citidel.org
• NCSTRL
• www.ncstrl.org
• NDLTD
• www.ndltd.org and etdguide.org
• NSDL
• www.nsdl.org
• Virginia Tech Digital Library Courseware
• http://ei.cs.vt.edu/~dlib
• Virginia Tech Digital Library Research Laboratory (DLRL)
• http://www.dlib.vt.edu (5S, 5SL, AmericanSouth.Org, CSTC, ENVISION,
MARIAN, NDLTD, NSDL, OAI, ODL)
• Virginia Tech DLRL OAI Projects
• http://www.dlib.vt.edu/projects/OAI/
• Repository Explorer
• http://purl.org/net/oai_explorer
More Links
• ARC Cross-Archive Search Service
• http://arc.cs.odu.edu/
• Dublin Core Metadata Initiative
• www.dublincore.org
• E-Prints DL-in-a-box
• www.eprints.org
• Open Archives Initiative
• http://www.openarchives.org
• OAI Metadata Harvesting Protocol
• http://www.openarchives.org/OAI/openarchivesprotocol.htm
• XML Schema Validator
• http://www.w3.org/2001/03/webdata/xsv
• XML Tools at W3C
• http://www.w3.org/XML/#software