Demonstrating the Use of MyLifeBits Software
Seungwon Yang, Ben Congleton, George Luc, Manuel A. Pérez-Quiñones, Ed Fox
Department of Computer Science
Virginia Tech
Blacksburg, VA 24061
+1 540-231-6931
{seungwon, bconglet, georgeluc, perez, fox} @vt.edu
ABSTRACT
2.
Microsoft SQL server 2005
MyLifeBits is both an application and a framework to manage a
personal lifetime of memories. It supports Microsoft SenseCam
use. We will demonstrate the MyLifeBits software called ‘Digital
Memories,’ showing how each Digital Memories component
works, how it captures user’s computer activity, and how the user
can view the resulting log data. We will explain the use of a
digital library to manage data from two SenseCams for: 1)
students in the Virginia-Maryland Regional College of Veterinary
Medicine, and 2) students supported by our Assistive
Technologies office. Scenarios for each application domain are
included.
3.
Digital Memories
H.3.7 [Information Storage and Retrieval]: Digital Libraries –
User issues, System issues;
H.3.3 [Information Storage and Retrieval]: Information Search
and Retrieval – Information Filtering;
H.1.2 [Models and Principles]: User/Machine Systems – Human
factors;
General Terms
Design, Experimentation, Human Factors.
Memories,
Ubiquitous
Computing,
1. INTRODUCTION
Once computer hardware has the capacity for life-long data
storage [1], we have the opportunity to create new uses of this
information in the support of everyday life as well as for
professional uses. At Virginia Tech, we are exploring how lifelong data capture can be used to improve the quality of life of
users. Data is captured using both MyLifeBits software (for
computer activity capture) and SenseCams (for audio, image, and
GPS data capture). Currently, we have installed the software and
are investigating its use. Once we receive two SenseCams from
Microsoft, further research will be conducted as described in
scenarios presented below.
Digital Memories Installation
Three software systems should be installed sequentially.
1.
Digital Memories help: It contains help and
configurations for each component.
Extending Digital Memories: It has help on extending the
software.
Gpx Import: It is used to import GPX files to load GPS points
into the database.
NTFS Sync Configuration: It lets you add/remove folders to be
monitored and included in the database.
PersonalVibe (GUI logger): It logs keyboard, mouse and window
activity. It is also installed in the Start/Programs/Startup folder so
that it will start automatically.
Keywords
Personal
After installation, a new group under Start/Programs called "MSR
Digital Memories" includes ten components:
dmInfo: It shows basic info about what database you are using
and some of the installed software.
Categories and Subject Descriptors
MyLifeBits,
SenseCam
Digital Memories Components
MS Windows Internet Information Services (IIS)
QuickStats: It uses Excel to generate reports from the information
in the database.
ShellV2: The Digital Memories shell supports search and
refinement to explorer what you have in your database.
TripReplay: It display GPS trails and location-stamped photos.
VibeLogViewer: It displays some of the information captured by
the PersonalVibe logger.
Adding Toolbars to IE and Outlook

IE toolbar – Start Internet Explorer, then select
View/Toolbars/DigitalMemories.

Outlook toolbar - The digital memories toolbar will
automatically be added.

Digital Memories Screensaver – It displays photos and
video clips and lets you rate & annotate them.
What is a SenseCam?
A SenseCam has multiple sensors. Its strap hangs around the
user’s neck.
required for different animals. The students open up their laptops
and click ‘Sync Data’ button on the screen. This synchronizes the
SenseCam data of the four group members. Each display shows
four images of each procedure from different angles allowing the
group to carefully examine the techniques.
When Kara gets home she places her SenseCam on the dock to
recharge and downloads the recorded data into her laptop. Later
in the evening, Kara connects to the course website. It shows a
wealth of information including lecture notes, audio and image
data provided by the professor, Kara and her peers. Kara studies
the images and audio file of the lecture, glancing at her
annotations.
Scenario 2 - a day in the life of a student with MS

A portable device developed by Microsoft

It captures daily approx. 2000 VGA images, audio,
GPS, temperature, light level and movement data.

Captured SenseCam data can be imported into
MyLiftBits allowing users to search and view
information they need.

We will receive two SenseCams soon.
Digital Memories Components that Support
the SenseCam Data Import and View
SenseCamImport: Users can load SenseCam data, “.csv” files,
into Digital Memories database.
SenseCamViewer: It allows users to view the loaded SenseCam
data.
Future Research Plan
The SenseCam provides large amounts of data from
an integrated collection of sensors (ultra wide angle
photo, audio, GPS, temperature, time, etc.).
MyLifeBits helps integrate that with other sources, including
personal computer applications. From all this we will connect
event sequences to construct instances of scenarios.
Scenario 1 - a day in the life of a Veterinary Medicine student
Kara, who is a second year student in the veterinary school,
turns on her SenseCam hanging around her neck. Everyday she
hurries to her 8 am classes. There, while her SenseCam records
audio and images, she adds comments on the lecture notes. After
taking three classes in a row, she feels a little drowsy, but
remains confident since she knows the audio of the lectures is
being recorded in her SenseCam for later review.
During her lunch break, she has a review session with her
clinical-techniques group about yesterday’s physical exam
procedures. The clinical-techniques class requires thorough
reviews because different physical examination procedures are
John has muscular dystrophy and is unable to move from one
place to another without the help of a motorized wheelchair. His
arms are weak and fragile and any intense workout could exhaust
his whole body. Still, he tries to do everything himself without the
help of others. He sees himself as any other student on campus.
However, there are times when architectural barriers cause him
to surrender. His care-giver, Ben, would be happy to follow John
to class to see if he can help mitigate some of the barriers.
However, John believes he should be self-sufficient, and has told
Ben that he can handle everything himself.
On a normal day, John rides the elevators to his class on the third
floor. Before class he takes a restroom break. He notices that the
door handle is situated in a way that hinders a smooth entrance
into the restroom. After maneuvering his chair while pulling the
restroom door, he finally gets in. Tired and almost out of breath
he goes into the accessible station. Upon his exit he goes through
the same difficulties when he tried getting in.
With the help of the SenseCam, John’s daily activities have been
recorded. John uses the audio and pictures from the SenseCam to
analyze the day’s activity and help him remember key events.
Furthermore, he shares with Ben some of the SenseCam data. Ben
uses the SenseCam to study barriers and problems John faced.
Ben sees a navigational map of the routes John takes to get to
and from class; he uses this data to help the Assistive
Technologies Staff identify locations used by students with
disabilities. He classifies sites, noting those which might need
further improvement or re-design. Thus, Ben is able to assist John
in making student life much easier.
ACKNOWLEDGMENTS
This work is sponsored by a Microsoft Research Memex award.
2. REFERENCES
[1] M. Czerwinski, D. Gage, J. Gemmell, T. Catarci, C.C.
Marshall, M.A. Pérez-Quiñones, M.M. Skeels (2006) Digital
Memories in an Era of Ubiquitous Computing and Abundant
Storage. Communications of the ACM, 49(1), p. 44-50.
ACM Press: New York, NY, USA
[2] J. Gemmell, G. Bell, R. Lueder, S. Drucker and C. Wong
(2002) MyLifeBits: fulfilling the Memex Vision, in
Proceedings of the tenth ACM international conference on
multimedia, ACM Press: Juan-les-Pins, France. p. 235-238.