TAUCHI – Tampere Unit for Computer-Human Interaction
Human-Technology Interaction
Project Work
(TIEVS84)
Markku Turunen
Meeting 1
TAUCHI – Tampere Unit for Computer-Human Interaction
Contents
• Course information
• Project topics
• Project examples
TAUCHI – Tampere Unit for Computer-Human Interaction
Course information 1
• Learning and methodological aims:
– the technologies, methods and tools needed to
design, implement and evaluate interactive services
in general and pervasive services in particular (e.g.,
no regular computer applications or web-services)
– Group working skills
– Presentation skills
– Development skills
TAUCHI – Tampere Unit for Computer-Human Interaction
Course information 2
• The main task is a project work
• Includes assignments for design, construction
and evaluation of interactive services
• Will be done in small groups (3-5 people).
• Basic project (5 cu): a proof-of-concept
prototype (can be a mock-up)
• Extended project (10 cu): a functional
prototype
TAUCHI – Tampere Unit for Computer-Human Interaction
Course information 3
• The course has four meetings:
– Student presentations of projects
– Discussions
• Work methods: from analysis of existing
research to concrete implementations of novel
interactive services
TAUCHI – Tampere Unit for Computer-Human Interaction
Course information 4
• The course requires good knowledge of humantechnology interaction
• Implementation (programming) skills are not
mandatory
– The constructive parts of the course (e.g., a
mockup) can be developed with suitable high-level
tools
– Still, having a programmer in the group is not a bad
idea ;-
TAUCHI – Tampere Unit for Computer-Human Interaction
Course information 5
• There are multiple courses which provide
suitable background for this course:
– Interaction Techniques (HTIS60)
– Multimodal Interaction (HTIS79)
– Usability Evaluation Methods (HTIS81)
TAUCHI – Tampere Unit for Computer-Human Interaction
Course information 6
• Since this is an advanced course, you are
required to seek information.
• Most importantly, you need to seek knowledge
on interaction techniques and interaction
devices which you choose to use in your project
work.
• Work done in the courses “Multimodal
Interaction” and “Interaction Techniques” can
be utilized here.
TAUCHI – Tampere Unit for Computer-Human Interaction
Course information 7
• Projects in this course can be combined with
projects from the “Interaction Techniques”
course
– and even with some other courses
• If combined with other projects, there must be
a clear description of what is done for each
course
• Combined course works need to be approved by
lecturers of both courses in advance
TAUCHI – Tampere Unit for Computer-Human Interaction
Course information 8
• All assignments (parts of the project work) are
mandatory
• One member of each group should present their
work in each meeting
• Remote connection possibility
TAUCHI – Tampere Unit for Computer-Human Interaction
Course information 9
• Participants must keep up the number of
working hours – reported on individual basis
• 1 cu = 27 working hours, 5/10cu =135/270 hours
• Group members can get different amount of
credits
TAUCHI – Tampere Unit for Computer-Human Interaction
Course information 10
• Reporting by categories:
–
–
–
–
–
–
Design (interaction/interface)
Development (programming)
Evaluation (testing)
Hardware construction
Assignments (incl. slides and meetings)
Information seeking (and other work)
• In addition, a short summary of activities
• Done on weekly basis, checkpoints at the
meetings
TAUCHI – Tampere Unit for Computer-Human Interaction
Course information 11
• Note: the course was organized during the
years 2012-2014 as “Pervasive Interaction in
Smart Environments” (TIEVS61).
• This is essentially the same course with more
generic approach.
• You can’t take this course if you have
previously completed TIEVS61.
TAUCHI – Tampere Unit for Computer-Human Interaction
Course Moodle
• All course related information is in the course
Moodle:
– https://learning2.uta.fi/course/view.php?id=13342
• Please do not return assignments or any other
material by e-mail
TAUCHI – Tampere Unit for Computer-Human Interaction
Guidelines for assignments
• Proper descriptions are required:
– e.g., “ users: home users” – or “c programming” -this is definitely not enough!
– Instead: “users: The application is primarily
targeted for 20-50 year old adults who are living
with children. The users should not have major
motoric disabilities, since the gesture interface
requires full operation of both hands. It can be used
by children who have necessary motoric skills…”
– You can use small font/add additional slides if
necessary
TAUCHI – Tampere Unit for Computer-Human Interaction
• Gesture 1: Raise-to-talk. The user raises the phone in front of his
or her mouth (corresponding to vertical/up position). The
orientation of the phone activates the recording of the audio. This
provides a natural way for speech input activation in the media
center domain, and it also helps speech recognition by bringing
the phone microphone closer to the mouth. At this point, the
feedback icons (gestrure identicators, the animated lips ) in the
GUI are activated, and haptic and auditory feedback is given on
the phone.
TAUCHI – Tampere Unit for Computer-Human Interaction
Contents
• Course information
• Project topics
• Project examples
TAUCHI – Tampere Unit for Computer-Human Interaction
Possible Environments
• Home environments: home automation, smart
homes
• Work environments: banks, offices, industrial
settings
• Public environments: e.g., museums, libraries
• Urban environments: city streets, shopping
malls
• Vehicles, public transportation
• XR (Virtual, Augmented and Mixed Reality)
TAUCHI – Tampere Unit for Computer-Human Interaction
Possible Interaction Techniques
•
•
•
•
•
•
•
Embodied interaction: e.g., gestures
Spatial interaction
Spoken interaction (ASR, TTS)
Auditory interaction (e.g., earcons, music)
Intelligent lighting
Tangible interaction
XR technologies
TAUCHI – Tampere Unit for Computer-Human Interaction
Possible Interaction Devices
• Sensors and actuators: pressure sensors, IRsensors, thermometers etc.
• Lighting hardware: e.g., DMX-controlled LEDs
• Raspberry-PI + necessary additions (e.g., WLAN
etc.)
• Arduino microcontrollers
• Kinect, IR cameras
• Mobile devices
• VR/AR/MR/360 hardware
TAUCHI – Tampere Unit for Computer-Human Interaction
Technologies for pervasive interactive
services
• In principle, any available hardware/software
technology can be used in the projects
• In practice, a variety of sensors, Arduinos,
Kinects, Raspberry PI’s, Leap Motion, VR
glasses, and a lot of lighting hardware and
smartphones are readily available
– Other hardware can be acquired depending on costs
and availability
– For software, freely available / open source
solutions are preferred, but licensing commercial
software is not out of question
TAUCHI – Tampere Unit for Computer-Human Interaction
Arduino
• Arduino Uno and Leonardo bords are readily
available
• All other hardware can be acquired based on
the project needs
TAUCHI – Tampere Unit for Computer-Human Interaction
Raspberry PI
• Raspberry PI’s + cases, SD cards, and USB and
HDMI cables are readily available
• Other hardware must be acquired separately
(in principle, many USB devices which have a
Linux driver can be used)
• Numerous Linux images can be downloaded and
installed to the SD cards
TAUCHI – Tampere Unit for Computer-Human Interaction
Sensors
• Pressure, dootswitch and distance sensors, and
a Eobody3 USB8 Sensorbox are readily available
• Different sensors for Arduino can be acquired
based on the project needs
TAUCHI – Tampere Unit for Computer-Human Interaction
Kinect + other gesture sensors
• Numerous Kinects (V1 & v2) are readily
available
• Several SDKs available
• In-house software available (incl. gesture
recognition)
• Other possible devices: PS3 Move,
Wiimote, Leap, …
TAUCHI – Tampere Unit for Computer-Human Interaction
Motion Capture
• Two sets of infrared cameras marked based
infrared tracking (skeleton tracking, facial
tracking, rigid bodies i.e. object location and
orientation)
• 1 x V:120 Duo, 640x480 120fps, USB
• 10 x Flex3, 640x480 100fps, USB, 2 x hubs
• 24 x Prime 13, 1280x1024 240fps, Ethernet, 3 x
PoE switches
• 1 USB dongle license for Motive Body
• 1 USB dongle license for Tracking Tools
TAUCHI – Tampere Unit for Computer-Human Interaction
Lighting hardware
• DMX512 controlled led PAR RGB
lights (full RGB control, max 40Hz
update frequency)
• Moving head lights: spots and
washers
• Enttec DMX USB Pro controllers
• Philips Hue + other consumer
solutions
• Light tubes, LED strips, and
BlinkM MaxM Smart LEDs
• Software with a lighting simulator
TAUCHI – Tampere Unit for Computer-Human Interaction
Tellstick
• Easy home automation solution: controls
electronic devices, such as light switches (easy
to obtain)
• Several models available (one or two,
standalone)
• A web GUI for high-level programming, APIs and
software for more complex programming
TAUCHI – Tampere Unit for Computer-Human Interaction
Mobile devices
• In principle any mobile device can be used as a
part of interaction
• We have several Android devices available
• Also, VR headset are available
• If SIM cards are needed, this can be
agreed separately
• Other devices might be possible
as well
TAUCHI – Tampere Unit for Computer-Human Interaction
XR
• Numerous XR hardware devices are available
• VR-wireless & mobile: Samsung Gear VR
• VR: cables & PC & stations: HTC Vive, Oculus
Rift
• VR: cables & PC: Samsung HMD Odyssey
• VR: cables & PS4: Playstation VR
• AR: Meta 2
• Oculus Go
• 360 video cameras
TAUCHI – Tampere Unit for Computer-Human Interaction
Possible Software
•
•
•
•
•
•
•
Automatic Speech recognition (ASR) software
Text-To-Speech (TTS) software
Kinect SDKs
OpenCV, Alvar, …
Panda3D, Processing
Unity
…
TAUCHI – Tampere Unit for Computer-Human Interaction
Contents
• Course information
• Project topics
• Project examples
TAUCHI – Tampere Unit for Computer-Human Interaction
Project Examples 2012-2017
• Quick look:
– Plant monitoring system
– Foot Gesture to Unlock Your Door
– Ambient house information display
– Good Vibes
• Closer look:
– Pervasive Indoor Air Quality Sensor Interaction
– KiNXT
– PulseTure
– Projective Game Surface
– Piccolo Restaurant Seating System
– Tambu 360
– Virtual Presenter
TAUCHI – Tampere Unit for Computer-Human Interaction
Project Examples: Plant Monitoring
TAUCHI – Tampere Unit for Computer-Human Interaction
Project Examples: Foot Gesture to
Unlock Your Door
TAUCHI – Tampere Unit for Computer-Human Interaction
Project Examples: Ambient information
display
TAUCHI – Tampere Unit for Computer-Human Interaction
Project Examples: Good Vibes
https://www.youtube.com/watch?v=PIv6ea_cX4A&feature=youtu.be
TAUCHI – Tampere Unit for Computer-Human Interaction
Project Examples 2012-2017
• Quick look:
– Plant monitoring system
– Foot Gesture to Unlock Your Door
– Ambient house information display
– Good Vibes
• Closer look:
– Pervasive Indoor Air Quality Sensor Interaction
– KiNXT
– PulseTure
– Projective Game Surface
– Piccolo Restaurant Seating System
– Tambu 360
– Virtual Presenter
TAUCHI – Tampere Unit for Computer-Human Interaction
Project Examples 2012-2017
• Quick look:
– Plant monitoring system
– Foot Gesture to Unlock Your Door
– Ambient house information display
– Good Vibes
• Closer look:
– Pervasive Indoor Air Quality Sensor Interaction
– KiNXT - video
– PulseTure
– Projective Game Surface
– Piccolo Restaurant Seating System
– Tambu 360
– Virtual Presenter
TAUCHI – Tampere Unit for Computer-Human Interaction
Project Examples 2012-2017
• Quick look:
– Plant monitoring system
– Foot Gesture to Unlock Your Door
– Ambient house information display
– Good Vibes
• Closer look:
– Pervasive Indoor Air Quality Sensor Interaction
– KiNXT
– PulseTure - video
– Projective Game Surface
– Piccolo Restaurant Seating System
– Tambu 360
– Virtual Presenter
TAUCHI – Tampere Unit for Computer-Human Interaction
Project Examples 2012-2017
• Quick look:
– Plant monitoring system
– Foot Gesture to Unlock Your Door
– Ambient house information display
– Good Vibes
• Closer look:
– Pervasive Indoor Air Quality Sensor Interaction
– KiNXT
– PulseTure
– Projective Game Surface – video
– Piccolo Restaurant Seating System
– Tambu 360
– Virtual Presenter
TAUCHI – Tampere Unit for Computer-Human Interaction
Project Examples 2012-2017
• Quick look:
– Plant monitoring system
– Foot Gesture to Unlock Your Door
– Ambient house information display
– Good Vibes
• Closer look:
– Pervasive Indoor Air Quality Sensor Interaction
– KiNXT
– PulseTure
– Projective Game Surface
– Piccolo Restaurant Seating System
– Tambu 360
– Virtual Presenter
TAUCHI – Tampere Unit for Computer-Human Interaction
Project Examples 2012-2017
• Quick look:
– Plant monitoring system
– Foot Gesture to Unlock Your Door
– Ambient house information display
– Good Vibes
• Closer look:
– Pervasive Indoor Air Quality Sensor Interaction
– KiNXT
– PulseTure
– Projective Game Surface
– Piccolo Restaurant Seating System
– Tambu 360
– Virtual Presenter
TAUCHI – Tampere Unit for Computer-Human Interaction
Project Examples 2012-2017
• Quick look:
– Plant monitoring system
– Foot Gesture to Unlock Your Door
– Ambient house information display
– Good Vibes
• Closer look:
– Pervasive Indoor Air Quality Sensor Interaction
– KiNXT
– PulseTure
– Projective Game Surface
– Piccolo Restaurant Seating System
– Tambu 360
– Virtual Presenter