Mirror Me @ Ubicomp 2008S
Meng-Chieh Yu
Kenneth
2008/6/20
1
Outline
1. Introduction
2. Related Work
3. Method
 Bio-signal
 Computer Vision
 Multimedia
4. Interaction Design
5. Future Work
2
Outline
1. Introduction
2. Related Work
3. Method
 Bio-signal
 Computer Vision
 Multimedia
4. Interaction Design
5. Future Work
3
 Importance of Respiration
 Respiration - Important for Life, Important for
your performance
 Respiration functions can be changed by
learning.(Fried R, et al., 1993)
 Correct respiration might make the person be
relaxed, reduces the blood pressure and
promotes a healthy body.(Rosenbaum E., 2004; Litchfield P.M.,
2006)
4
 Mirror me
• Improve the respiration habits for common user
• Encourage users to use belly respiration
• Correct breathing exercise can make the person be relaxed,
reduces the blood pressure and promotes a healthy body.
Bluetooth
Display
5
Outline
1. Introduction
2. Related Work
 Computer Vision
 Biofeedback
3. Method
 Bio-signal
 Computer Vision
 Multimedia
4. Interaction Design
5. Future Work
6
 Computer Vision - Logitech
 Detect the features of user’s face
 Make your webcam with special effects that put more fun into chatting
http://www.logitech.com/index.cfm/webcam_communications/
7
 Biofeedback – Wild Divine
 Healing Rhythms transform your physical and mental health is in your
hands -- literally.
 Finger sensors connect to your and measure :
- Heart Rate Variability, a key indicator of your long-term health
- Skin Conductance Levels, literally the level of your perspiration and a
sensitive measure of stress, or relaxation.
http://www.wilddivine.com/
8
 Biofeedback – BioGraph Infiniti
 BioGraph Infiniti provides a multimedia rich graphical experience,
while capturing and analyzing raw data.
http://www.thoughttechnology.com/
9
Outline
1. Introduction
2. Related Work
3. Method
 Bio-signal
 Computer Vision
 Multimedia
4. Interaction Design
5. Future Work
10
 Bio-signal
12
Respiration
Sensor
11
 Bio-signal
12
Chest Volume
• Exhale/Inhale Time
• Respiration Freq.
• Respiration Time
• Exhale/Inhale Ratio
• Chest/Belly Ratio
Belly Volume
Air Change Point Total Volume
12
 Computer Vision 1 2
Original Image
• Color : RGB image
• Resolution : 320 * 240
640 * 480
Gaussian Background Model
• Effective Background
Subtraction Method
• Single Gaussian Model
Face Detection
• Face Detection
(using OpenCV lib.)
− Face Position
− Face Size
• Chest/Belly Detection
• Shoulder Detection
13
 Computer Vision 1 2
Detecting the Human
Face
Estimate User’s
Chest & Belly
Estimate User’s
Shoulder
14
 Multimedia
Sound
• Respiration Guidance
− Inhale Time / Exhale Time
• Evaluation
− Silver Crown / Golden Crown
15
Outline
1. Introduction
2. Related Work
3. Method
 Bio-signal
 Computer Vision
 Multimedia
4. Interaction Design
5. Future Work
16
 Interaction Design
 Guidance
– Butterfly
– Vibrator
 Reflection
– Air Flow
 Evaluation
– Crown
– Command Message
17
 Interaction Design
Visual
Sound
Touch
Guidance
Reflection
Evaluation
18
Mirror ME
19
Outline
1. Introduction
2. Related Work
3. Method
 Bio-signal
 Computer Vision
 Multimedia
4. Interaction Design
5. Future Work
20
 Future Work
• Computer Vision
– Face Detection (auto login)
– Detecting the Face Features
• Mirror interaction
– Transparent Mirror
– Touch Screen
• Developing Environment (Virtools)
– Advanced Effect
– Particle System
– 3D Animation
21