Human Needs and Mobile Devices:
Small, Fast & Fun
Ben Shneiderman
ben@cs.umd.edu
Founding Director (1983-2000), Human-Computer Interaction Lab
Professor, Department of Computer Science
Member, Institutes for Advanced Computer Studies &
Systems Research
University of Maryland
College Park, MD 20742
Human-Computer Interaction Laboratory
Interdisciplinary research community
- Computer Science & Psychology
- Information Studies & Education
(www.cs.umd.edu/hcil)
User Interface Design Goals
•
•
Cognitively comprehensible:
Consistent, predictable & controllable
Affectively acceptable:
Mastery, satisfaction & responsibility
NOT:
Adaptive, autonomous & anthropomorphic
Scientific Approach (beyond user friendly)
•
•
•
•
•
Specify users and tasks
Predict and measure
 time to learn
 speed of performance
 rate of human errors
 human retention over time
Assess subjective satisfaction
(Questionnaire for User Interface Satisfaction)
Accommodate individual differences
Consider social, organizational & cultural context
Design Issues
•
•
•
•
Input devices & strategies
 Keyboards, pointing devices, voice
 Direct manipulation
 Menus, forms, commands
Output devices & formats
 Screens, windows, color, sound
 Text, tables, graphics
 Instructions, messages, help
Collaboration & communities
Manuals, tutorials, training
www.awl.com/DTUI
hcibib.org
useit.com
Library of Congress
• Scholars, Journalists, Citizens
• Teachers, Students
Visible Human Explorer (NLM)
• Doctors
• Surgeons
• Researchers
• Students
NASA Environmental Data
• Scientists
• Farmers
• Land planners
• Students
Bureau of Census
• Economists, Policy
makers, Journalists
• Teachers, Students
NSF Digital Government Initiative
• Find what you need
• Understand what you Find
Census,
NCHS,
BLS, EIA,
NASS, SSA
www.ils.unc.edu/govstat/
International Children’s Digital Libary
Zooming User Interfaces
www.cs.umd.edu/hcil/jazz
www.cs.umd.edu/hcil/datelens
ZUI: Pocket PhotoMesa
www.windsorinterfaces.com
Leonardo’s Laptop
The old computing is about
what computers can do,
The New Computing is about
what people can do
mitpress.mit.edu/leonardoslaptop
www.cs.umd.edu/hcil/newcomputing
An Inspirational Muse:
Leonardo da Vinci (1452-1519)
Renaissance Man
•
•
•
•
Combined
science & art
Integrated
engineering & esthetics
Balanced
technology advances
& human values
Merged
visionary & practical
Health & Wellness Devices
•
•
•
More people are familiar with technologies
Low cost makes them widely available
?Social shift? to take greater responsibility for
personal health care, fitness & wellness
 Personal health & wellness devices
However:
• Lack of common interface inhibits growth
• Lack of common file format prevents collaboration
Surveys: www.cs.umd.edu/hcil/iHealth/
Class Projects: www.cs.umd.edu/class/spring2004/cmsc434/
Health & Wellness Devices
•
•
•
•
Monitoring chronic conditions
 Asthma, diabetes, obesity, high blood pressure
 Depression, anxiety, sleep disorders
Aging in place
 Cognitive & memory aids, monitoring, social interaction
Sports & training
 Pedometers, body fat meters, bathroom scales
Family history & personal health records
 Genetic history, vaccinations, medications, allergies
 Emergency treatment info, medical contacts
www.marketresearch.com/map/prod/924670.html
Blood Glucose
www.homediagnosticsinc.com/
Blood Pressure & Pulse Rate
www.promedproducts.com
Heart Rate & Thermometer
Body Fat
www.linear-software.com/digitalcalipers.html
Standardize & Improve Health & Wellness Devices
Issues
•Ease of use
•Accuracy of device in use
•Logging to common file format
•Save/Send to health providers
•Annotation by patient & physician
•Interpretation of results
•Visualize to spot patterns
HCI Theories
Beneficial theories:
- Descriptive
- Explanatory
- Predictive
- Prescriptive
but the big step forward will be
- Generative Theories
to guide our invention of new technologies
Human Needs
•
What makes a mobile device different from
a Desktop/Laptop?
Human Needs
•
•
What makes a mobile device different from a
Desktop/Laptop?
What sensors do you want?
Human Needs
•
•
•
What makes a mobile device different from a
Desktop/Laptop?
What sensors do you want?
What do you want to store?
Human Needs
•
•
•
•
What makes a mobile device different from a
Desktop/Laptop?
What sensors do you want?
What do you want to store?
What messages do you want to get? Send?
Human Needs
•
•
•
•
What makes a mobile device different from a
Desktop/Laptop?
What sensors do you want?
What do you want to store?
What messages do you want to get? Send?
Do you see a pattern yet?
Mobile Device User Interface Taxonomy (DUIT)
(1) capture
share
info from a location
info to a location
(2) monitor
alert when
info stream output
info stream changes
(3) locate
identify
objects (nearest cafe or hotspot)
objects (name of a person or flower)
(4) gather
spread
messages from many people
message to many people
(5) participate as
relate to
individual in a group
individual in a group
Human Needs for Relationships
Relationships
• Self: working on your own
• Family & Friends: 2-50 close intimates
• Colleagues & Neighbors: 50-5000 acquaintances
• Citizens & Markets: 5000 and more
Human Needs for Activities
Activities
• Collect: Information
• Relate: Communication
• Create: Innovation
• Donate: Dissemination
Activities and Relationship Table (ART)
Activities
Relationships
Collect
Relate
Create
Donate
Self
Family & Friends
Colleagues & Neighbors
Citizenry & Markets
Skeptics corner
- Are relationships more complex?
- Are these useful activities?
Activities and Relationship Table (ART)
Activities
Relationships
Self
Family & Friends
Colleagues & Neighbors
Citizenry & Markets
Collect
Relate
Identicam
Donate
PhotoDiary
PhotoFinder
PhotoMesa
Album
sharing
PhotoFinder
Kiosk
PhotoWall
PhotoFinder
Webstarter
Create
StoryStarter
Family
photo
history
PhotoQuilt
Photo
sharing
Activities and Relationship Table (ART)
Activities
Relationships
Self
Collect
Medical log
InfoDoors
Citizenry & Markets
Create
Donate
Diary
Find-aFriend
Family & Friends
Colleagues & Neighbors
Relate
MusicLists
Family
vacation
history
Medical
diagnosis
Tourist
sharing
Send-a-Link
GatherEmail
WebBushes
WorldWide
Med
Million
person
communities
Takeaway Messages
•
•
Mobile devices are huge opportunity
 Small, fast & fun
 Low-cost, easy-to-use, specific service
Focusing on human needs will guide you
to more successful product designs
 Device User Interface Taxonomy (DUIT)
 Activities & Relationship Table (ART)
The old computing is about
what computers can do,
The New Computing is about
what people can do
Human-Computer Interaction Laboratory
www.cs.umd.edu/hcil
Takeaway Messages
•
•
•
Design functions to serve human needs
Usability + reliability to prevent frustration
Engage users with fun
 Alluring metaphors
 Compelling content
 Attractive graphics
 Appealing animations
 Satisfying sounds
Photo Annotation
•
Annotating & repurposing photos in the
Semantic Web context
Retrieve by personal attributes:
 name, date, topic?
 age, country, organization??
 weight, necksize, hair color?????
Retrieve by mediated attributes:
 numbers of papers/citations in WWW
 other conferences they attended
 names of students they supervised
Goals of Public Access
•
Enable full participation by every citizen
 Voting, social security services, passports,
licenses, registrations, permits, recreation,
state-county-city government services
•
Offer services to many residents & visitors
 Visa applications, tourism info, employment,
healthcare, police, fire, education, training,
museums, parks, libraries
Universal Usability Challenges
•
•
•
Technology variety
 Fast & slow modems, small & large displays
 Diverse platforms, multiple versions
User diversity
 Novice & expert, old & young
 Users with disabilities, poor literacy, or low motivation
Bridge the gap between what users know
and what they need to know
 Multi-layer interfaces
 Help vs. ShowMe!
Technology variety
1 to 100 range in processor speeds
286 486
Pentium
1 to 100 range in screen sizes
Palm
devices
30,000
Laptops
480,000
Device Independence
Input: keyboard, speech,...
Output: visual, auditory,...
Conversion
Large Desktop or Wall Display
3,840,000 pixels
1 to 100 range in network bandwidth
9.6K 56K
10,000Kbps
Software Versions
Compatibility
File conversion
Multiple platforms
User diversity: Accommodate all users
Skills
Computer newbie to hacker
Knowledge
Disabilities
Visual, auditory, motoric, cognitive
Domain novice to expert
Age
Young to old
Gender
Male or Female
Disabling conditions
Mobility, injury, noise, sunlight
Income
Impoverished to wealhy
User diversity: Accommodate all users
Race
Ethnicity
Religion
National Origin
Culture
Western, Eastern, developing...
Personality
Introvert vs extravert
Thinking vs feeling
Risk aversion
Locus of control
Planful vs playful
Literacy
Fluent to illiterate
Multiple languages
Gaps in User Knowledge-Strategies
Bridge the gap between what users know and
what they need to know
Design
Multi-Layered
Task-oriented
Online Learning
(evolutionary, phased)
Introductory tutorials
Getting started manuals,
Cue cards
Walkthroughs/Demos
Minimalist/Active
Training
Fade-able scaffolding
Training wheels
Minimalist
Online help
Context sensitive, tables of contents,
Indexes, Keyword search,
FAQs, answer gardens
Gaps in User Knowledge-Strategies
Bridge the gap between what users know and
what they need to know
Customer service
Email
Phone
Help desks
Supplements
Online manuals, paper
Audio, video,
Live lecture, peer training, personal trainer
Community
Newsgroups, online communities
Chat rooms
Public Access & Universal Usability
• Our Project Resources
www.ils.unc.edu/govstat
www.cs.umd.edu/hcil/newcomputing
www.universalusability.org
www.otal.umd.edu/uupractice
• Government Access
www.usability.gov
www.firstgov.gov
www.fedstats.gov
• Guidelines
www.usability.gov/pdfs/guidelines.html
www.access-board.gov/sec508/status.htm
Designing the User Interface: 4th Edition
I: Introduction
1 Usability of Interactive Systems
2 Guidelines, Principles, and Theories
II: Development Processes
3 Managing Design Processes
4 Evaluating Interface Designs
5 Software Tools
III: Interaction Styles
6 Direct Manipulation and Virtual Environments
7 Menu Selection, Form Fillin, and Dialog Boxes
8 Command and Natural Languages
9 Interaction Devices
10 Collaboration
IV: Design Issues
11 Quality of Service
12 Balancing Function and Fashion
13 User Manuals, Online Help, and Tutorials
14 Information Search and Visualization
Treemap – Monitoring
www.hivegroup.com
Treemap – Gene Ontology
www.cs.umd.edu/hcil/treemap/
Dynamometers & Inclinometers
Information Visualization
The eye…
the window of the soul,
is the principal means
by which the central sense
can most completely and
abundantly appreciate
the infinite works of nature.
Leonardo da Vinci
(1452 - 1519)
PhotoMesa
www.cs.umd.edu/hcil/photomesa
LifeLines
www.cs.umd.edu/hcil/lifelines/
Treemap: Stock market, industry clustered
Treemap – Product catalogs
www.hivegroup.com
Personal Medical
Anxiety &
Depression
Asthma