Territoriality*and*Behaviour**
at*and*around*
Large*Ver4cal*Publicly8Shared*
Displays**
Alec*Azad*
Introduc4on*and*Mo4va4on*I*
•  Problem?**
–  Tradi4onal*single8user*design*paradigm*s4ll*used*
by*public*kiosks*
–  But,*we*go*out*to*venues*in*social*groups*
•  e.g.,*friends,*family,*co8workers*
Introduc4on*and*Mo4va4on*II*
•  (Possible)*Solu4on?**
–  Support*collabora'on*on*a*large8screen*display*
–  Support*mul4ple*groups*in*parallel*
–  Combine*with*exis4ng*ambient*displays*which*
show*generic*content*(e.g.,*flight*schedules)*
*Drawn*by*Daniel*Vogel*
Introduc4on*and*Mo4va4on*III*
•  Example?*
–  An*installa4on*at*a*large*amusement*park*
–  @Top:*Maps*and*events*shown*for*everyone*
–  @Bo&om:*Families*can*plan*out*their*day*****
(((((((((((((((((((((((collabora.vely(
*Drawn*by*Daniel*Vogel*
Research*Ques4ons*
(a)
(b)
1.  How*do*people*use*public*kiosks?*
2.  How*does*territoriality*come*into*play*–*both*in*
(c)
(d)
front*and*on*the*display?*
3.  How*do*people*collaborate*on*ver4cal*displays?*
(e)
(f)
4.  Would*people*even*use*this*technology???*
(a)
(b)
(c)
(d)
(g)
(h)
(i)
(j)
Study*1*8*Field*
•  Observa4onal*study:*watched*and*learned*
(e)
(f)
(g)
(h)
(k)
(l)
(m)
–  Scouted*three*kiosks*in*public*and*tracked*
behaviour*over*their*sessions*
–  Jo\ed*down*notes*and*diagrams*
(n)
(o)
vs.*
(i)
(j)
Study*2*8*Control*
•  Got*par4cipants*to*solve*jigsaw*puzzles*on*a*
ver4cal*whiteboard*
–  Varied*group*sizes*
–  Varied*puzzle**
****configura4ons*
•  Video*recorded*
–  Watch*and*re8watch!*
•  Qualita4ve*coding*
Inform*Design*
•  Derive*a*set*of*design*specifica4ons*using*
results*from*Studies*1*+*2*
•  Developed*an*ad8hoc*system*using*the*
Microsob*Kinect*NUI(
Thank*you*8**
Happy*Researching*!!*
[Google Suggest, Retrieved September 2010]
[Firefox 3.6.12 on Windows XP]
Queries Related to the Menu Bar Issue
•
•
•
•
•
•
•
•
•
•
•
“firefox menu bar missing”
“restore menu bar firefox”
“how to get menu bar back firefox” “firefox restore menu bar”
“restore firefox menu bar”
“menu bar missing firefox”
“firefox menu bar disappeared”
“firefox show menu bar”
“unhide menu bar firefox”
“firefox recover menu bar”
…
150+
Query suggestions
Searched once every
32 min
Harvesting Search Queries
Query auto-completion services act
as if backed by a prefix tree.
firefox
firefox a
firefox b
...
firefox z
firefox aa
firefox ab
...
firefox az
A breadth-first search can be used
to uncover many queries that start
with a given prefix.
...
In total, Google reveals 74,795 distinct
searches relating to the use of Firefox
Putting it all together
“firefox”
CUTS
Process
Opr. Instructions
Troubleshooting
cache clear
not respond
clear cookie
not open pdf
cookie delete
slow
block website
crash
proxy
check not spell
delete history
…
constant crash
…
Example 1: GIMP “black and white”
Speak the user’s language
Many queries inquire about converting a
color image to black and white.
Relevant commands are grayscale,
desaturate and channel mixer.
Example 1: GIMP “black and white”
Speak the user’s language
Many queries inquire about converting a
color image to black and white.
Relevant commands are grayscale,
desaturate and channel mixer.
90+
Distinct query phrasings
Searched once every
74 min
Example 5: Ubuntu Superuser
Running privileged commands in traditional Ubuntu Linux:
afourney@desktop:~$ su
Password:
su: Authentication failure
Example 5: Ubuntu Superuser
Running privileged commands in traditional Ubuntu Linux:
130+
Query phrasings
Searched once every
afourney@desktop:~$ su
Password:
su: Authentication failure
30 min
“”how to draw a
circle in gimp“”
howto drawa circleingimp
“”how to draw a
circle in gimp“”
howto drawa circleingimp
Relevant Pages
“”how to draw a
circle in gimp“”
howto drawa circleingimp
Relevant Pages
Some part of each
page is relevant to
the query
“”how to draw a
circle in gimp“”
howto drawa circleingimp
Relevant Pages
Use QAP passage retrieval
to find short, relevant
passages
[Clarke et al., 2000 & 2001]
“”how to draw a
circle in gimp“”
Mention of GIMP’s Ellipse Select feature
Mention of GIMP’s Stroke Selection
feature
howto drawa circleingimp
Relevant Pages
4 mentions of
the Ellipse Select
feature
3 mentions of the
Stroke Selection
feature
Ellipse Select
“”how to draw a
circle in gimp“”
Stroke Selection
Search Queries
“”gimp convert to
black and white“”
“”gimp selective
desaturation
“”
“”how to draw a
circle in gimp“”
“”gimp put text
on circle“”
Search Queries
System Features
Desaturate
Ellipse Select
Grayscale
Stroke Selection
System Features
Ellipse Select
Select an elliptical region.
Feature: “ellipse select”
Web searches related to “ellipse select”
• gimp draw circle (see also: stroke selection, shift)
• draw ellipse gimp (see also: border, shift)
• gimp text on circle (see also: text along path, text)
• draw a straight line in gimp (see also: shift, pencil)
• gimp correct red eye (see also: red-eye removal)
• vignette effect gimp (see also: opacity, blur)
• …
Task-Centric User Interfaces
Ben Lafreniere
Fil Krynicki
Michael Terry
Andrea Bunt
Matthew Lount
Task-Centric User Interfaces
Motivation from ingimp
A version of GIMP instrumented to gather rich
usage data from users (while respecting privacy)
[Terry et al. 2008]
All gathered data was made publicly available
We analyzed 2 years worth of usage data,
including logs of 4198 sessions from 211 users
What does a typical ingimp
session look like?
Users’ sessions tended to be short
~6 minutes of active usage (median)
…and contained few commands
~24 command invocations (median)
(IQR 107, min 1, max 9236)
~6 unique commands (median)
(IQR 9, min 1, max 85)
Small command vocabularies
Median command vocabulary:
~27 distinct commands per user
(IQR 29, min 1, max 169)
Less than 6% of the nearly 500 commands
available in ingimp
Users’ command vocabularies are idiosyncratic
Users’ command vocabularies are idiosyncratic
Undo
(used by 91% of users)
The typical ingimp user performs relatively
short, targeted tasks using a small (and
personal) subset of the available functionality
Key Design Elements
• Crowdsourced interface customization
– UI adapts to the needs of the community
• Task-centric UI customization
– Interface can provide hints as to how to complete a task
• Wiki-based documentation for tasks / commands
– Brings the phenomena of community documentation and
tutorial creation into the application’s UI
• In-application search
– Short-circuits the existing practice of using search to learn
how to perform tasks