Eyes on the World:
Putting Your Photos in Context
Mor Naaman
Yahoo! Research Berkeley
Attraction Map of Paris
Stanley
Milgram,
1976.
Psychological
Maps of Paris
http://zonetag.research.yahoo.com
2
Attraction Map of London
Jaffe et al,
2006.
http://zonetag.research.yahoo.com
3
Outline
• Wisdom of the tags
– mining information from geo-tagged photos
• ZoneTag
– your photos in context
• Why we tag
– a user study of tagging
http://zonetag.research.yahoo.com
4
Alternative Outline
How?
Why?
What?
http://zonetag.research.yahoo.com
5
Information Overload?
Flickr
“geotagged”
http://zonetag.research.yahoo.com
6
What can we derive?
Given all photos from a
geographic region,
- find a “representative”
summary set
- generate a meaningful
visualization
• Dataset:
(photo_id, user_id, latitude, longitude)
(photo_id, tag)
http://zonetag.research.yahoo.com
7
Issues to Tackle
• Noisy data
• Photographer biases
– In locations
– In Tags
• Wrong data
Whatever, color, city, spectrum, santa barbara, california, usa,
Lookatme, Herbert Bayer Chromatic Gate
http://zonetag.research.yahoo.com
8
Intuition
More “activity” in a certain location indicates
importance of that location
Tag that are unique to a certain location can
suggest importance of that location
http://zonetag.research.yahoo.com
9
(Very) Simple Example
http://zonetag.research.yahoo.com
10
Summary of San Francisco
Golden Gate Bridge
TransAmerica
AT&T
Baseball Park
Golden Gate
Ocean Beach
Twin Peaks
Bay Bridge
http://zonetag.research.yahoo.com
Golden Gate
Chinatown
11
Tag Maps
http://zonetag.research.yahoo.com
12
Tag Maps
http://zonetag.research.yahoo.com
13
Outline
• Wisdom of the tags
– mining information from geo-tagged photos
• ZoneTag
– your photos in context
• Why we tag
– a user study of tagging
http://zonetag.research.yahoo.com
14
Outline
How?
Why?
What?
http://zonetag.research.yahoo.com
15
Another Look at the Tag Map
http://zonetag.research.yahoo.com
16
ZoneTag(?)
“Everything in the world exists to end up
in a photograph”-- Susan Sontag
How would we:
Create/store?
Find?
Share?
Discover?
http://zonetag.research.yahoo.com
17
Why Cameraphones?
• Numbers, numbers…
– 500,000,000
•
•
•
•
Programmable
Context-aware
Network-connected
Quality… it’s getting there
(Source: Future Image Inc.)
http://zonetag.research.yahoo.com
18
Current Mobile Experience
• Difficult to share (or
even save!)
• Hard to find
– No context
– No semantic
information
http://zonetag.research.yahoo.com
19
ZoneTag Experience
• 2-click upload (same key!)
• Photo uploaded with location and time
metadata
http://zonetag.research.yahoo.com
20
ZoneTag Experience
• Tagging made easy
– Tag/annotate your photos from the phone
http://zonetag.research.yahoo.com
21
Where do locations come from?
• Bluetooth GPS (when available)
• User-contributed cell tower mapping
http://zonetag.research.yahoo.com
22
Where do tags come from?
• Tags I used in this context (`home’)
• Tags my friends used in this context
(`Research Meeting’)
• Tags other people used in this context
(`PARC’, ‘Mor Naaman’, `This talk sucks’)
http://zonetag.research.yahoo.com
23
Where do tags come from?
• Stuff around you:
– Yahoo! Local
– Upcoming.org (`Mor Naaman @ PARC’, `PARC
George E. Pake Auditorium’)
• Stuff from you (any RSS 2.0 feed):
– Calendar (G, Upcoming.org, Kiko,…)
– Favorite hangouts
http://zonetag.research.yahoo.com
24
Suggested Tags
“When I went to
upload, there were
already all these
exotic tags like "Bill
Graham Civic
Auditorium" and
"Bob dylan live"
available...it sure
was convenient to
just select and
go…”
http://zonetag.research.yahoo.com
25
Where do tags go?
• Back to the original RSS items
– Upcoming.org
• Action Tags
– Trigger a call to a web service
• With parameters
– Command line - from your phone
Rotate:right
Email:dad
Group:zonetag
http://zonetag.research.yahoo.com
Scanr:document
26
I’m Too Lazy (you’re not alone)
• Tagging is the means, not the goal
• Benefits even if you never tagged a
single image
(?)
(?)
(?)
(Bradley Horowitz, elatable.com)
http://zonetag.research.yahoo.com
27
Things We Learned
• “Best” feature: 2-click upload
– Even users that often tag
• For some, last chance to annotate
• Mobile tagging - not just experts, not all
experts…
http://zonetag.research.yahoo.com
28
Things We Learned
• Tagging behavior:
– All over the place
The relative number of users for different ranges
of tag usage (n=172)
30%
25%
20%
15%
10%
5%
0%
<0.5 <1 <1.5 <2 <2.5 <3 <3.5 <4 <4.5 <5
– More than Shozu
– Connected to privacy
http://zonetag.research.yahoo.com
29
5+
Outline
• Wisdom of the tags
– mining information from geo-tagged photos
• ZoneTag
– your photos in context
• Why we tag
– a user study of tagging
http://zonetag.research.yahoo.com
30
Outline
How?
Why?
What?
http://zonetag.research.yahoo.com
31
Why Tag?
• What are tags?
http://zonetag.research.yahoo.com
32
Why Tag?
Bay Bridge, Fog, [San Francisco, 94105]
http://zonetag.research.yahoo.com
33
Why Tag?
RedSox, Fenway, GreenMonster, [Boston,
02215], …
http://zonetag.research.yahoo.com
34
Why Tag?
Liz, sunbathing, sunny, sunglasses, concrete,
[Palo Alto, 94306], …
http://zonetag.research.yahoo.com
35
Tag Affordances on Flickr
• Displayed next to photo
• Can be used to search:
– Your own photos
– Others’ photos
– Public photos
http://zonetag.research.yahoo.com
36
Tags on ZoneTag
• By default, tags are kept from one photo
to next
• Tags used in a location will be suggested
in that location
– To you
– To others
• Immediate (i.e., during event)
• Place name tags added automatically
http://zonetag.research.yahoo.com
37
User Study
• 13 ZoneTag users (23-45, 9m, 4f)
• All “taggers” (no use to ask non-taggers
why they tag)
• Structured interviews
http://zonetag.research.yahoo.com
38
Expected…
• Organization/retrieval
• Creator/synthesizer
• “Tagging for community”
http://zonetag.research.yahoo.com
39
Found…
• Motivation taxonomy
• No “synthesizers”
• Inspired by community
• Organization/retrieval
• Creator/Synthesizer
• “Tagging for community”
X
http://zonetag.research.yahoo.com
40
Motivation Taxonomy
“If I tagged ahead
of time I can go
back and get all
“…I then think
my pictures of [my
“well, maybe I
children]…”
should tag this” so
I can find it again
later”
“I’m obsessivecompulsive”
http://zonetag.research.yahoo.com
41
Motivation Taxonomy
“I want at least one
hook of
association in
there that can help
me reconstruct…”
http://zonetag.research.yahoo.com
42
Motivation Taxonomy
“I tag photos with
what I think might
be interesting to
“I know
that
other
people,
tagging
can
stuff I think
connect
people
willmy
like”
“I want
to look
photos
to at
all [my
activities,
and get
neighborhood’s]
more interest”
tags. … That’s
definitely a
reason I’m
putting these tags
in ”
http://zonetag.research.yahoo.com
43
Motivation Taxonomy
“…so that my
friends can see
what I am up to”
I can tell my mom
[with the tag] “look,
“Iwe
leftwent
reviews
to…”of
places – like at the
airport, when my
flight was delayed,
I tagged “Aloha Air
sucks.”
http://zonetag.research.yahoo.com
44
Breakdown
Self
Social
(friends/family)
(public)
Organization
P2,P6,P10, P12,
P3, P8, P11
Communication
P8,
P6
P1, P4, P7, P11,
P6, P8
P1, P6, P2
P3, P9, P13,
P2, P4, P6, P7,
P8, P11, P12
http://zonetag.research.yahoo.com
45
Suggested Tags
• Useful for entry, when
they “work”
– Critical mass needed
– Better filtering
• Inspire and give example
• Overtagging may be issue
http://zonetag.research.yahoo.com
“Tag suggestions
were huge for me;
they really cut
“Idown
thought:
on typing”
this is
how I want it to
work
“This all
person
the time!”
was
in my phone for a
“I try to use as
month - who is
many suggested
she???”
tags that apply. …
I also use it for
auto-completion –
I type “s” to get
San Francisco”
46
Open Questions
•
•
•
•
•
Those who don’t…
Better filtering, tag suggestions
Longer usage trends
Effect of community on usage
…
http://zonetag.research.yahoo.com
47
Final Notes
• All Flickr/ZT photos, Creative
Commons or with author permission
•
•
•
•
•
http://www.flickr.com/photos/frozenquack/106111967/
http://www.flickr.com/photos/bryce_edwards/272002447/
http://www.flickr.com/photos/plasticbag/188818779/
http://www.flickr.com/photos/groovymother/131591824/
http://www.flickr.com/photos/deaneckles/220482624/
http://zonetag.research.yahoo.com
48
ZoneTag For All
• Everything we can do, you can do
(better?)
– Cell ID translation
– Suggested Tags
– More…
• Use ZT-technology with your app!
• Email me
http://zonetag.research.yahoo.com
49
Thanks
With: Shane Ahern, Simon King, Rahul Nair, Nathan
Good, Marc Davis, Morgan Ames, Dean Eckles, Alex
Jaffe, Tamir Tassa
Download, sign up, get the full scoop:
http://zonetag.research.yahoo.com
Become an intern, get involved:
Email me.
Mor Naaman
mor@yahoo-inc.com
http://zonetag.research.yahoo.com
50