TAUCHI – Tampere Unit for Computer-Human Interaction
Multimodal Technologies for
Interactive Multi-purpose Spaces
Tampere Unit for Computer – Human Interaction (TAUCHI)
University of Tampere, Finland
http://www.uta.fi/sis/tauchi/
TAUCHI – Tampere Unit for Computer-Human Interaction
Technologies for interactive spaces
• Large displays with embodied spatial interaction
– Gestural interaction, support for multiple users,
interaction with the audience
• Interactive mixed-reality environments
– Spatial mixed-reality environments connect physically
remote places
• Light and sound based captivating physical exercises
– Moving lights, sound and stories for children and adults
• Numerous other examples in different contexts
TAUCHI – Tampere Unit for Computer-Human Interaction
Multimodal Interaction Technologies
• In our research projects we have worked with
multimodal technologies which enable:
– Embodied interaction (location, gestures, spoken interaction)
combined with mobile devices
– Support for multiple users, tracking of users, entertainment and
content reacting to freely moving people
– Spatial audio techniques enable both public and personal audio
for entertainment and information needs
– Technologies to provide interaction between the stage
performers and the audience (audio, gestures, mobile)
– Tracking by-passers and individuals entering an active area to
attract them to interact with the content and performers
TAUCHI – Tampere Unit for Computer-Human Interaction
Piloted and Deployed Systems
A playful multi-user system for energy use
guidance in the national housing affair event
in Finland, 2012 (approx. 150 000 visitors)
Three large connected multi-user screens
Spatial multichannel localized audio
Supports up to 9 simultaneous users
Full-body gestural interaction
TAUCHI – Tampere Unit for Computer-Human Interaction
TAUCHI – Tampere Unit for Computer-Human Interaction
Piloted and Deployed Systems
An event infotainment system used in numerous
conferences since 2010
Interaction combines large screen and mobile devices
Speech, gesture and touch screen input
TAUCHI – Tampere Unit for Computer-Human Interaction
TAUCHI – Tampere Unit for Computer-Human Interaction
Piloted and Deployed Systems
“Information wall” infotainment system in
continuous use at the main building of UTA
since spring 2013 + numerous special events in
different places from 2012 onward
Embodied interaction
Multi-user support
Live information from various data sources
TAUCHI – Tampere Unit for Computer-Human Interaction
TAUCHI – Tampere Unit for Computer-Human Interaction
TAUCHI – Tampere Unit for Computer-Human Interaction
TAUCHI – Tampere Unit for Computer-Human Interaction
Piloted and Deployed Systems
Spoken and Gestural infotainment system for
cultural events as a part of Turku 2011
Cultural Capital year (Turku main library)
Speech and gesture input
Dynamically generated visualisations (metro map style
presentation of selected events)
TAUCHI – Tampere Unit for Computer-Human Interaction
TAUCHI – Tampere Unit for Computer-Human Interaction
Piloted and Deployed Systems
Audio and light-based interaction combined
with story-telling and physical games piloted
in numerous schools in Finland 2012-2013 and
in major public events
Lighting hardware and audio controlled in
synchronized manner
Progress is controlled by a teacher
using a wireless controller
Engaging stories make children exercise
TAUCHI – Tampere Unit for Computer-Human Interaction
TAUCHI – Tampere Unit for Computer-Human Interaction
Piloted and Deployed Systems
Stage automation and creative tools for
performers in production use since 2011
(Science Center Heureka, Finland –
thousands of visitors)
Automation of stage lighting and
audio-visual content presentation
Sensor-based interaction allows magic-like
capabilities for the performers
Highly cost efficient hardware solutions
TAUCHI – Tampere Unit for Computer-Human Interaction
TAUCHI – Tampere Unit for Computer-Human Interaction
Piloted and Deployed Systems
Simulation of remote spaces with augmented
reality, simulation and physical light
environment
Speech input and user location tracking
Simultanous control of virtual environment and lighting in
real life
TAUCHI – Tampere Unit for Computer-Human Interaction
TAUCHI – Tampere Unit for Computer-Human Interaction
Piloted and Deployed Systems
Embodied virtual edutainment environments
targeted for distributed usage piloted in
numerous schools in Finland, 2013
Gesture based input + Voice over IP communication
between remote participants
Users navigate in virtual environments
consisting of photographic panoramas
Users can point at panoramas to get additional information
TAUCHI – Tampere Unit for Computer-Human Interaction
TAUCHI – Tampere Unit for Computer-Human Interaction
Piloted and Deployed Systems
Mobile contextual edutainment applications
support group usage and user created
content, piloted in numerous schools in
Finland, 2013
Location aware mobile software
In addition to viewing and listening to content, users can
create new content by recording audio and video
The content can be compiled into
presentations on mobile device
TAUCHI – Tampere Unit for Computer-Human Interaction