Lifelogging to Lifebraries
(L2L)
Outline proposal for a
Network of Excellence
Objective ICT-2009.4.1 Digital
Libraries and Digital Preservation
Target Outcome (e) Interdisciplinary
Research Networks
1
1. Cultural Heritage
What is Cultural Heritage
• Culture is based on what people do, on
what everyone does
• Recording what everyone is doing
allows us to preserve cultural heritage
at a hitherto unseen breadth and depth
• Lifelogging – a term with baggage,
Lifebraries is our new community
– Definition is recording, digitally, aspects of
one's life.
– Captures one's life experiences and
includes explicit User Generated Content
(UGC) as well as ambient logging
2
2. Lifelogging happens
2. Explicit Lifelogging
• There are several, and a growing number, of
lifelogging projects in Europe and beyond
• MemoryLane, SenseCam, LiveMemories,
LivingKnowledge, GLOCAL, Memories for
Life Grand Challenge, HAPTIMAP,
Oldenburg wellness trials
• Based on wearable cameras
(SenseCam/Vicon), GPS recording tracks,
accelerometers (independent/phones to
record walk, sit, drive, etc.), Bluetooth
sensing other BT devices (phones) we
encounter, etc.
3
3. Lifelogging happens
3. Implicit Lifelogging
• Record indirectly or infer activities –
from FaceBook, Twitter, phone/Skype
calls, SMS, email and web, IPTV,
LinkedIn, Flickr (etc.) photos, YouTube
videos, blogs, online calendars,
financial transactions.
• Smart meters on domestic electricity,
gas, water infer use of different
appliances, infer domestic activities.
• Sousveillance vs. Surveillance
4
4. Why Lifelogging
Why ?
• Find incidents from our past
• Personal journal of one's history
• Discover changes in our lifestyles,
short term or longer
• Re-live the past as a memory
prosthesis - Alzheimer's/dementia &
healthy aging
• Share our past with others
• Build a community memory of some
event
• ... all these are library uses
5
5. What’s the Problem ?
Problem ?
• All happening with a technological
drive, with no input from: information
science, memory science,
neurospychology, sociology, law,
ethics, governance, social acceptance,
curation
• Also, projects focus on lifelogging data
– no leverage of additional User Generated
Content to socially link different people's
views/lives/experiences
• Need for a new community, drawn
from all of the above.
6
6. CONSORTIUM
Alinari
DCU/CLARITY
DCU/Ethics
Glasgow
Leeds
Luleå
Namur
Oldenburg
Praeposit
QMUL
RSLIS
Trento
VicomTech
7
CONSORTIUM
Alinari
Alinari
DCU/CLARITY
DCU/Ethics
Glasgow
Leeds
Luleå
• Guardian of a photographic
‘corpus’ of >5.5M pictures,
historical and contemporary
• Responsible for the management
of an ongoing program of
exhibitions and publishing
Namur
RSLIS
• Relevant Expertise:
watermarking, digital rights
management, content provider,
preservation and image
restoration, multimedia content
supply
Trento
• Relevant EU Projects: GLOCAL
VicomTech
• People: Andrea de Polo
Oldenburg
Praeposit
QMUL
8
CONSORTIUM
Dublin City University - CLARITY
Alinari
DCU/CLARITY
DCU/Ethics
Glasgow
Leeds
Luleå
Namur
Oldenburg
• Harvesting & harnessing of large
volumes of sensed information,
from both the physical world in
which we live, and the digital
world of modern communications
& computing
• >50% of all SenseCam
publications have CLARITY
authors
Praeposit
QMUL
RSLIS
Trento
VicomTech
• Relevant Expertise: Information
Management in Ambient
Lifelogs, human digital memories
• People: Alan F. Smeaton, Cathal
Gurrin, Aiden Doherty, Noel E.
O’Connor
9
CONSORTIUM
DCU - Institute of Ethics
Alinari
DCU/CLARITY
DCU/Ethics
Glasgow
Leeds
Luleå
• Studies in Ethics, Law and
Technology
• Play a leading role in raising
public awareness of, and
stimulating debate about, ethical
issues
Namur
RSLIS
• Relevant Expertise: ethics of
emerging technologies, ethical
issues in life sciences,
healthcare, technology and
innovation, and business and
society
Trento
• People: Bert Gordijn
Oldenburg
Praeposit
QMUL
VicomTech
10
CONSORTIUM
University of Glasgow
Alinari
DCU/CLARITY
DCU/Ethics
Glasgow
Leeds
• International reputation in
research on information retrieval
methods
• Focus on Multimedia information
management
Luleå
Namur
Oldenburg
Praeposit
QMUL
RSLIS
Trento
VicomTech
• Relevant Expertise: Developing
advanced retrieval models,
studying the role of emotion in
search, personalization and
adaptive retrieval
• People: Joemon M. Jose, C. J.
(Keith) van Rijsbergen
11
CONSORTIUM
University of Leeds
Alinari
DCU/CLARITY
DCU/Ethics
Glasgow
Leeds
Luleå
Namur
Oldenburg
Praeposit
QMUL
RSLIS
Trento
VicomTech
• World-class reputation in
memory science &
neuropsychology, with links to
local and national clinicians in
the National Health Service
• Memory impairment research at
Leeds work includes some of the
first work with the SenseCam
wearable camera in memory
impaired groups
• Relevant Expertise:
Autobiographical memory,
memory rehabilitation, memory
dysfunction in dementia &
healthy aging, the self & memory
• People: Chris Moulin, Martin
Conway
12
CONSORTIUM
Luleå
Alinari
DCU/CLARITY
DCU/Ethics
Glasgow
Leeds
• Past projects geared towards
health-care (e.g. FP5
MobiHealth), digital preservation
and context aware social
networking
Luleå
Namur
Oldenburg
Praeposit
QMUL
RSLIS
Trento
VicomTech
• Relevant Expertise: advanced
applications for eHealth, support
for people with disabilities using
enabling technologies, context
discovery in social networks
• Relevant EU Projects:
COGKNOW
• Relevant Regional Projects:
MemoryLane
• People: Arkady Zaslavsky, Kåre
Synnes, Josef Hallberg, Johan
13
E. Bengtsson
CONSORTIUM
Namur
Alinari
DCU/CLARITY
DCU/Ethics
Glasgow
Leeds
Luleå
Namur
• Research in the field of new
technologies with a special
emphasis on privacy issues,
individual and public freedom in
the Information Society and
Internet Governance
• Member of the Belgian
Commission on Data Protection
Oldenburg
Praeposit
QMUL
RSLIS
Trento
VicomTech
• Relevant Expertise: social
science & philosophy, ethical,
political and legal challenges
raised by the new information,
communication and surveillance
technologies
• People: Yves Poullet, Claire
Lobet-Maris, Antoinette Rouvroy,
Nathalie Grandjean
14
CONSORTIUM
Oldenburg
Alinari
DCU/CLARITY
DCU/Ethics
Glasgow
Leeds
Luleå
• Identify, enhance, and evaluate
new techniques of information
and communication technology
for design of environments for
aging
• Detection of daily activities by
monitoring
Namur
Oldenburg
Praeposit
QMUL
RSLIS
Trento
VicomTech
• Relevant Expertise: Information
summarisation, person activity
classification
• Relevant Industry Projects:
CeWe Color
• Relevant EU Projects: HaptiMap
• People: Susanne Boll, Jochen
15
Meyer, Wilko Heuten
CONSORTIUM
Praeposit
Alinari
DCU/CLARITY
DCU/Ethics
Glasgow
Leeds
• Provides services such as
technology research,
organisation of business and
cooperation events, EU project
proposal support and eLearning
consultations
Luleå
Namur
Oldenburg
• Relevant Expertise: Project
Administration & Management
Praeposit
QMUL
• People: Craig Stewart
RSLIS
Trento
VicomTech
16
CONSORTIUM
Queen Mary University London
Alinari
DCU/CLARITY
• Semantic multimedia analysis
DCU/Ethics
• Leveraging user generated
content for enhancing
representation
Glasgow
Leeds
Luleå
Namur
• Knowledge extraction from
socially driven content
generation
Oldenburg
Praeposit
QMUL
RSLIS
Trento
VicomTech
• Relevant Expertise: multimedia
content analysis, implicit &
explicit user relevance feedback
• People: Ebroul Izquierdo,
Krishna Chandramouli, Alan
Pearman, Qianni Zhang, Tomas
Piatrik
17
CONSORTIUM
Alinari
DCU/CLARITY
DCU/Ethics
Glasgow
Leeds
Luleå
Royal School of Library and
Information Science
• Experimental research on
cognitive aspects of user-system
interaction
• Graduate school with focus on
theoretical and practical
information science
Namur
Oldenburg
Praeposit
QMUL
• Relevant Expertise: library
science storage and retrieval
• People: Peter Ingwersen, Pia
Borlund, Birger Larsen
RSLIS
Trento
VicomTech
18
CONSORTIUM
Trento
Alinari
DCU/CLARITY
DCU/Ethics
Glasgow
Leeds
Luleå
• Investigations into social structure;
inequalities & collective actions;
social norms, political & ethical
values; social policies in EU
• Social construction of technology;
knowing and learning as a
collective
Namur
Oldenburg
Praeposit
QMUL
RSLIS
Trento
VicomTech
• Relevant Expertise: management
of cultural memories, shared
cultural experiences, sociology
• Relevant Regional Projects:
LiveMemories
• Relevant EU Projects:
LivingKnowledge, GLOCAL
• People: Fausto Giunchiglia, Silvia
Gherardi, Pierre Andrews 19
CONSORTIUM
VicomTech
Alinari
DCU/CLARITY
DCU/Ethics
• Develop advanced techniques to
understand and manage
multimedia assets
Glasgow
Leeds
Luleå
Namur
• Relevant Expertise: semantic
enrichment of multimedia,
ontology construction
Oldenburg
Praeposit
QMUL
• People: Julián Flórez, Jorge
Posada
RSLIS
Trento
VicomTech
20
CONSORTIUM
SCIENCES
HUMANITIES
21
CONSORTIUM
HUMANITIES &
USE CASES
LAW &
PHILOSOPHY
COMPUTER
SCIENCE
COGNITIVE
SCIENCE
22
CONSORTIUM
HUMANITIES
&
LifeLog Technology
USE CASES
COMPUTER
SCIENCE
Image Processing
LifeLog Interpretation
QMUL
DCU-CLARITY
Lulea
VicomTech
Social Interaction
Information Search
Glasgow
Oldenburg
Praeposit
Health & Wellness
Management
Library Science
Trento
RSLIS
Shared Culture
Alinari
Namur
Content Rights
DCU-Ethics
LAW &
Social Acceptance
PHILOSOPHY
Curation (Industry)
Leeds
COGNITIVE
Memory
Science
SCIENCE
23
CONSORTIUM
7. The L2L Work Programme structure
• WP1- Management (Praeposit)
• WP2: Integration activities (Glasgow)
• WP3: Technological Challenges in
Lifebraries (DCU)
• WP4: Cognition, Memory, Emotion in
Lifebraries (Leeds)
• WP5: Societal issues in Lifebraries (Namur)
• WP6: Use cases and Demonstrators
(QMUL)
• WP7: Dissemination, exploitation and
standardisation activities (DCU)
24
CONSORTIUM
7. The L2L Work Programme structure
•
WP1- Management (Praeposit)
–
–
–
–
–
–
–
•
Activity 1.1: Network Administration
Activity 1.2: Network Communications and Reporting to the Commission
Activity 1.3: Financial Management
Activity 1.4: Quality Control
Activity 1.5: Risk Management
Activity 1.6: Legal and Ethical Reporting
Activity 1.7: Objective tree and assessment metrics
WP2: Integration activities (Glasgow)
–
–
–
–
Activity 2.1: Towards a Virtual Competence Centre
Activity 2.2: Researcher Mobility Program
Activity 2.3: Cooperation in Education, teaching materials and PhD formation
Activity 2.4: Lifebrary Festival
–
Activity 2.5: Pan-European Integration
•
•
•
WP3: Technological Challenges in Lifebraries (DCU)
–
–
–
–
–
–
–
•
Activity 4.1: Cognitive Issues in archiving and interacting with lifebraries
Activity 4.2: Memory impairment and lifebraries
Activity 4.3: Emotional issues in preserving lifebraries
Activity 4.4: Lifebrary selection and preservation models
Activity 4.5: Lifebrary curation model
Activity 4.6: Browsing, search and retrieval models in lifebraries
Activity 4.7: The self and other: What is remembered about who in lifebraries
WP5: Societal issues in Lifebraries (Namur)
–
–
–
–
–
–
•
Activity 3.1: Data Preparation and Pre-Processing
Activity 3.2: Evidence by Combination Techniques
Activity 3.3: Context Modeling and User/Community Profiling
Activity 3.4: Event Detection & Summarisation
Activity 3.5: Event Visualisation Schemes
Activity 3.6: Semantic Modeling /Ontology
Activity 3.7: Community Profiling using Social Networks
WP4: Cognition, Memory, Emotion in Lifebraries (Leeds)
–
–
–
–
–
–
–
•
Activity 5.1: Stakeholders cartography
Activity 5.2: Case Studies
Activity 5.3: Legal Issues in Lifebrary Construction and Archiving including Privacy & Security Issues in Lifebraries
Activity 5.4: Social Impact and societal Issues
Activity 5.5: Ethical Issues
Activity 5.6: Dissemination
WP6: Use cases and Demonstrators (QMUL)
–
–
–
–
Activity 6.1: Virtual Laboratory
Activity 6.2: Evaluation Methodology
Activity 6.3: Data Set Creation and Ground Truth Generation
Activity 6.4: Case Studies
•
•
•
–
–
•
Summer Schools
Cross-disciplinary exploration
Autobiography-based Lifebraries
Societal Biographies-based Lifebraries
Preserving cultural heritage – Digital curation to Lifebrary
Activity 6.5: Distributed research environment and L2L Integration Platform
Activity 6.6: Lifebrary Archive
WP7: Dissemination, exploitation and standardisation activities (DCU)
–
–
–
–
–
Activity 7.1: Web portal & Promotional materials
Activity 7.2: Joint Publications
Activity 7.3: Standards and Technology Transfer
Activity 7.4: Societal Impacts
Activity 7.5: L2L Platform Challenge
25
8. Advisors
External Advisory Chamber
SCIENTIFIC
ADVISORY BOARD
•
•
•
•
•
•
•
•
•
Jim Gemmel (Microsoft)
Peter Scott (KMI, Open U)
Steve Mann (Toronto U)
Ramesh Jain (UC Irvine)
Hari Sundaram (ASU)
Gary Marchionini (UNC)
Nick Belkin (Rutgers)
Keith Oatley (Toronto U)
Rafael Capurro (Stuttgart
Media U)
INDUSTRIAL
ADVISORY BOARD
•
•
•
•
•
Eric Moore (FAST/Microsoft)
John Herlihy (Google)
Geoff Cross (Vicon)
Ron Yang (FaceBook)
Ricardo Baeza Yates (Yahoo!
Research, Barcelona)
• John Tait (IRF)
USER GROUP
• Emma Berry, MSR (Co-chair)
• Frank Nack, CWI (Co-chair)
26
9. A DigitalLibrary ?
Why is this a Digital Library, why this
call ?
• L2L matches perfectly with the aims of the call interdisciplinarity in composition.
• More than bridges, integrates
– technological, information and archival science & practice
– social and cognitive sciences
– law and ethics
• Creates a new research community where nontechnological partners are more than just
cheerleaders.
• Lifelogging is happening, building personal lifelogs,
explicitly, or implicitly, and 5 years from now …
• These lifelogs are our personal Digital Libraries.
• As Libraries, they are in need of inputs from all the
different L2L communities.
• We need to move from Lifelogging to Lifebraries.
27
CONSORTIUM
Questions:
• Collaborative research/integration
vs. community building
• 13 partners belonging to 4 areas,
42 months duration, €5M
Commission contribution
28