What is the Next Generation of Human-Computer Interaction? Introduction New Interaction Styles • • • • • • • • • • • • • Virtual and augmented reality Ubiquitous, pervasive, and handheld interaction Tangible user interfaces Lightweight, tacit, passive, or non-command Perceptual interfaces Affective computing Context-aware interfaces Ambient interfaces Embodied interfaces Sensing interfaces Eye-movement based interaction Speech and multi-modal interfaces .... Questions • Next generation or just disparate developments? • What is common? What things or ideas connect them? What differs? • Psychological evidence, theories • How to test or validate frameworks and concepts • Give leverage to move forward, predict, understand, find sweet spots? • Opportunities inspired by gaps uncovered A Starting Point: Reality-Based Interaction • Exploit skills/expectations user already has • Computer interaction more like interacting with rest of world • Ex: Navigation in VR • Ex: Tangible interaction with objects • Also: Operate system in world, combine with “normal” actions • Ex: Cell phone, ubicomp, context-aware Real vs. Artificial • Continuum not dichotomy • Exact duplicate of real world? • Reality plus extensions • Desktop GUI plus "find" command • Interact normally plus can turn on X-ray vision • Walk and move normally plus can fly by leaning • Grasp and move tangible architectural model • Separate our claims: • Is a good characterization of next generation • Is a good UI (not necessarily) Workshop Tasks • Find common elements for understanding, discussing, identifying a next generation of HCI • Researchers to consider this topic explicitly • Reality-based interaction as concrete starting point • Extend, expand, find support • Disagree, discredit, replace • Introduce alternative opposing or complementary approaches Workshop Outputs • Lens, common language • For viewing, discussing, comparing proposed new UI ideas • Provide coordinate axes, put into perspective, organize • Research agenda • Gaps, sweet spots suggested by frameworks • Ways to evaluate or validate frameworks • Community of HCI researchers • Thinking specifically about connecting our research to other developments in next generation HCI