NICT
Design & Developers Forum D12
Ubiquitous Human to Human Telecommunications
Systems Design, Development & Standardization
at Globecom 2006
30 November 2006
Ryoichi Komiya
Organizer/Chair
1
Presentations at this forum
Presenter
Ryoichi Komiya (NICT, Multimedia University)
NICT
Major presentation topics
The Super POTS
Hidenori Takahashi (KDDI Labs)
Tactile communication system
proposal using a mouse haptic
device
Akiko Watanabe (Keio University)
Intelligent space to pick up
verbal/nonverbal messages
Stewart Fallis (BT Research Department)
User Context within
Ubiquitous Environments
Yoshitaka Shibata (Iwate Prefectural University)
Feeling Communication
System
Takashi Matsuyama (NICT, Kyoto University )
Dynamic structure of human
verbal and nonverbal
communication
2
Panel discussion
Session 1:
Reviewing of current telecommunication systems from
the view points of emotion transmission.
Identifying most specific & effective emotions transmission
to substitute face to face conversation.
Session 2:
Sensor/actuator technologies to exchange nonverbal
messages over the networks.
Wrap up for future R&D directions.
3
NICT
-Towards the Super POTSD&D Forum
“Ubiquitous Human to Human
Telecommunications Systems Design,
Development & Standardization”
at Globecom 2006
30 November 2006
Ryoichi Komiya
National Institute of Information & Communications Technology
4
Table of Contents
NICT
1. Background of the Forum
2. Lacking information to be sent by current
telecommunication systems
3. The Super POTS
4. Transmission of nonverbal messages by the Super POTS
5. Super POTS Design, Development & Standardization
6. Expected outcomes of the Super POTS
5
1. Background of the Forum
NICT
1. Today’s telecommunication systems including the POTS and the
Internet are enough for business execution.
Because business communications are composed of agreements and
money movements.
2. However for the personal use, today’s telecommunication systems are
not satisfactory.
Because personal communications are composed of emotions.
Our intention is to build telecommunication systems which can
transmit emotional/nonverbal messages.
6
NICT
Face to face conversation
Wide spectrum range of non-verbal
communication
To understand people quickly
Smaller potential for misunderstanding
65-93 % of all meaning communicated
is attribute to nonverbal messages
7
2. Lacking information to be sent by current
telecommunication systems
NICT
Non verbal messages*
A. Physical Appearance
B. Gesture and Movement
C. Face and Eye Behavior
D. Vocal Behavior
E. Space
F. Touch
G. Environment
*: Virginia P. Richmond & James C. McCroskey, “Nonverbal
Behavior in Interpersonal Relations”, ALLYN AND BACON
8
A.
Physical Appearance
Sheldon’s system
Body type & Psychological type
NICT
Viscerotonic
Slow, sociable, emotional,
forgiving, relaxed
Endomorph
Oval-shaped body;
Heavy, large abdomen
9
NICT
Somatotonic
Confident, energetic, dominant,
enterprising, hot-tempered
Mesomorph
Triangular body shape;
Muscular, hard, firm, upright body quality
10
NICT
Cerebrotonic
Tense, awkward, meticulous,
tactful, detached
Ectomorph
Fragile physique;
Flatness of chest, poorly muscled limbs
11
NICT
BODY type self-descriptors
dependent
dominant
detached
calm
cheerful
tense
complacent
energetic
reticent
contented
impetuous
Self-conscious
sluggish
efficient
meticulous
placid
enthusiastic
reflective
leisurely
competitive
precise
cooperative
determined
thoughtful
12
NICT
Height, weight & skin color
Height: taller is preferred because it is often associated with
power and dominance
Weight: slim and trim are associated with success, good selfconcept, physical wellbeing and acceptability
Skin Color: “I have a dream that one day my little children
will not be judged by the color of their skin, but by the
content of their character” Martin Luther King
Unfortunately, that dream is yet to be fully realized.
13
NICT
Hair color
Hair color
Red: tempestuous
Brown: wholesome
Black: sultry
Blondes: having all the fun
14
NICT
Hair length
Hair length: has been associated with perceptions of
credibility (male speaker)
Short: high credibility
Long: low credibility
Think of U.S. presidents who had long hair!
15
NICT
Clothing
Ten decisions we might make about another person
based solely on clothing choice.
Economic level
Educational level
Trustworthiness
Social position
Level of sophistication
Economic background
Social background
Educational background
Level of success
Moral character
16
NICT
B. Gesture & Movement
Movement & communicator style
Dramatic: pictographs, drawings of
forms and figures in space, moving
dramatically from one place to another
Dominant: expansive body posture &
movement
Animate: repetitive head nods and
frequent smiles
Relaxed: posture, movement
Open: expansive, unreserved,
extroverted, approach oriented
Friendly: reduce distance,
forward leaning,
Contentious: assertive tone of
voice with forward leaning, arm
waving
Impression leaving:
combination of others
Attentive: active listening
17
NICT
C. Face & Eye behavior
The SADFISH* are represented by face and eye behaviors.
*
S: surprise
1
A: anger
2
D: disgust
3
F: fear
I: interest
S: sadness
1 Eyebrows and forehead 2 Eyes and eyelids
H: happiness
3 Lower face: Cheeks, nose & mouth
18
NICT
C. Face & Eye behavior (cont.)
Emotions
Three regions
Ratio
Sadness & fear
Eyes & eyelids
67% of the time
Anger
Cheeks, mouth, brows & forehead
Disgust blends
with surprise
Lower region
Happiness
Lower region and eyes and eyelids
98-99% of the time
Surprise
Brows/forehead
Eyes & eyelids
lower face
79% of the time
63% of the time
52% of the time
19
NICT
D. Vocal behavior
Information to be obtained from the human voice;
emotion, state of health, trustworthy vs. deceitful
characteristics, age and gender.
In one study, only 7 % of meaning in an interaction was
conveyed by the verbal content of spoken utterances and 38%
was conveyed through other vocal cues.*
*: tempo, resonance, pitch, silence & pause, accent, dialects
20
NICT
E. Space
The intimate: from touching to 18 inches
(lovers, relatives)
The personal: 18 inches-4 feet
(friends, close colleagues)
The social-consultative: 4 feet-8 feet
(work colleagues in a meeting)
The public: more than 8 feet
(people in public space)
21
NICT
F. Touch
Professionalfunctional touch
Impersonal, business like touch medical context,
trying on shoes, hair stylist
Social-polite touch
Limited form of interpersonal communication
Handshake, shoulder claps, kisses on each
cheek
Let another person know that we care for, value
and have an interest in her/him
Highly communicative, expressing caring, love
and emotional and affective attachment
Friendship-warmth
touch
Love-intimacy touch
Sexual-arousal touch
The most intense form of touch
22
NICT
G. Environment
Perceptional characteristics of environment
formality (churches, temples,.)
Other environmental
factors
attractiveness
warmth (family den, kitchen)
colors
privacy (smaller dining rooms in a restaurant ) lighting
familiarity (restaurants, gas stations)
temperature
constraint (crowded subway)
Scent & smell
Distance (too near, too far)
23
NICT
3. The Super POTS
Parties regenerated
by sensor/actuator
technologies
Calling party
Called party
Sensors
Actuators
Information processors
Sensors
Actuators
Information processors
UNI
NT
You can talk as if
your called party
were in front of you.
NT
Network
24
4. Transmission of nonverbal messages
NICT
by the Super POTS
Non verbal messages
Sensors & actuators
Physical Appearance
S: video cameras to capture entire human body
A: wide display
Gesture and Movement
S: video cameras to capture entire human body
A: wide display
Face and Eye Behavior
S: video camera to capture eye contact
A: display with a height of average human face
Vocal Behavior
S: microphones (bandwidth?)
A: receivers, speakers
Space
S: Video cameras to capture entire living room
A: wide display
Touch
S: Touch sensors
A: Touch actuators
Environment
S: Video cameras to capture entire living room, smell sensor
A: wide display, smell palette
25
5. Super POTS Design, Development &
Standardization
NICT
To develop telecommunication systems by which
you can fall in love with via network!!
Sensors & Actuators
Telecom Network
Network Termination (NT)
26
NICT
Wired/Wireless interfaces to
NT (to be standardized)
Sensors
Voice & sound
images
Heart beats
●
●
Touch
27
NICT
Wired/ Wireless Interfaces from
NT (to be standardized)
Actuators
Speakers, receivers
Displays, humanoid
robotics
Heart beat regenerator
Tactile devices
28
NICT
Super POTS Standardization
User Network Interface: wired/wireless
Sensors
Actuators
U
UNI
NT
Networks
U Interface (Subscriber transmission interface): wire/wireless
29
6. Expected Outcomes of the Super POTS
NICT
(1) Face to face communications with full eye contacts
(2) Reduction of business trips because of less
misunderstanding
(3) Negotiation of international disputes by
exchanging critical views
(4) Being a possible solution for war deterrent power
30
NICT
Thank you very much!!
31