ID 412C: Enhancing Human
Interface Experience by Adding
Haptics
David Yuan (Sr. Product Marketing Manager)
12 & 13 October, 2010
NASDAQ: IMMR
Version 1.1
© 2010 Immersion Corporation–Confidential
1
Mr. David Yuan
 Sr. Product Marketing Manager
– Responsible for market penetration & development within
Immersion Corporation for Touch Sense® haptics feedback
systems into touch screen/surface device markets
 Previous Experience
– Over 15 years experience in marketing, business development
and sales of semiconductor and electronics systems at several
companies, including most recently at AOpen and previously at
Zoran Corp., Acer Lab Inc., and Realtek Semiconductor serving
consumer and vertical applied computing markets
© 2010 Immersion Corporation–Confidential
2
Renesas Technology and Solution Portfolio
Microcontrollers
& Microprocessors
#1 Market share
worldwide *
ASIC, ASSP
& Memory
Advanced and
proven technologies
Solutions
for
Innovation
Analog and
Power Devices
#1 Market share
in low-voltage
MOSFET**
* MCU: 31% revenue
basis from Gartner
"Semiconductor
Applications Worldwide
Annual Market Share:
Database" 25
March 2010
** Power MOSFET: 17.1%
on unit basis from
Marketing Eye 2009
(17.1% on unit basis).
© 2010 Immersion Corporation–Confidential
Renesas Technology and Solution Portfolio
Microcontrollers
& Microprocessors
#1 Market share
worldwide *
Solutions
for
Innovation
ASIC, ASSP
& Memory
Advanced and
proven technologies
Analog and
Power Devices
#1 Market share
in low-voltage
MOSFET**
* MCU: 31% revenue
basis from Gartner
"Semiconductor
Applications Worldwide
Annual Market Share:
Database" 25
March 2010
** Power MOSFET: 17.1%
on unit basis from
Marketing Eye 2009
(17.1% on unit basis).
© 2010 Immersion Corporation–Confidential
4
Microcontroller and Microprocessor Line-up
Superscalar, MMU, Multimedia
High Performance CPU, Low Power
High Performance CPU, FPU, DSC
 Up to 1200 DMIPS, 45, 65 & 90nm process
 Video and audio processing on Linux
 Server, Industrial & Automotive
 Up to 500 DMIPS, 150 & 90nm process
 600uA/MHz, 1.5 uA standby
 Medical, Automotive & Industrial
 Up to 165 DMIPS, 90nm process
 500uA/MHz, 2.5 uA standby
 Ethernet, CAN, USB, Motor Control, TFT Display
 Legacy Cores
 Next-generation migration to RX
General Purpose
Ultra Low Power
Embedded Security
 Up to 10 DMIPS, 130nm process  Up to 25 DMIPS, 150nm process  Up to 25 DMIPS, 180, 90nm process
 190 uA/MHz, 0.3uA standby
 350 uA/MHz, 1uA standby
 1mA/MHz, 100uA standby
 Application-specific integration  Crypto engine, Hardware security
 Capacitive touch
© 2010 Immersion Corporation–Confidential
5
5
Microcontroller and Microprocessor Line-up
R8C
Superscalar, MMU, Multimedia
High Performance CPU, Low
Power
 Up to 1200 DMIPS, 45, 65 & 90nm process
 Video and audio processing on Linux
 Server, Industrial & Automotive
Haptics (touch
 Up to 500 DMIPS, 150 & 90nm process
 600uA/MHz, 1.5 uA standby
feedback)
 Medical, Automotive & Industrial
Solution
High Performance CPU, FPU, DSC
 Up to 165 DMIPS, 90nm process
 500uA/MHz, 2.5 uA standby
 Ethernet, CAN, USB, Motor Control, TFT Display
 Legacy Cores
 Next-generation migration to RX
General Purpose
 Up to 10 DMIPS, 130nm
process
 350 uA/MHz, 1uA standby
 Capacitive touch
Ultra Low Power
 Up to 25 DMIPS, 150nm
process
 190 uA/MHz, 0.3uA standby
 Application-specific
integration
© 2010 Immersion Corporation–Confidential
Embedded Security
 Up to 25 DMIPS, 180, 90nm
process
 1mA/MHz, 100uA standby
 Crypto engine, Hardware security
6
Innovation
The TouchSense System Components Include:

TouchSense Player

Off-The-Shelf Actuator

Tactile Effects Library for Common TouchScreen Actions
© 2010 Immersion Corporation–Confidential
7
Haptics Is The Future Of Digital Technology
Immersion brings a full fidelity haptic experience into the
controls to complete the user’s loop of reflex and instinct,
linking action to reaction for greater enjoyment, accuracy,
and safety. The result is less clutter, faster learning, and
greater awareness.
© 2010 Immersion Corporation–Confidential
8
Agenda






Company Introduction
Market & Opportunity
TouchSense® 2000 Series
TouchSense® 2000 Mechanical Overview
TouchSense® 2000 Electrical Overview
Q&A
© 2010 Immersion Corporation–Confidential
9
Key Takeaways
By the end of this session, you will be able to:




Recognize the value of Haptics
Understand how the Haptics system works
Identify where the Haptics solution should be used
Plan on developing & implementing the haptic system
© 2010 Immersion Corporation–Confidential
10
Company Highlights
The Haptics Company
Technology Leader
– Developing haptics
solutions since 1993
Established in Large and
Rapidly Growing Markets
– TouchSense in 350+ M devices
– Opportunity: 2 B devices per year
World Class Customer Base
– Samsung, Nokia, LG, Sony,
Lexus, BMW, CAE
Worldwide Support
– Offices in UK, EU, Korea, Taiwan,
Japan, US & Canada
Strong IP
– 900+ granted and pending patents
– Proven ability to defend IP
© 2010 Immersion Corporation–Confidential
11
Haptics – The Science of Touch
TouchSense Brings Digital Devices to Life with Touch Feedback
 Touch Feedback Allows You to Feel
–
–
–
–
–
The keys on a virtual keyboard
Button press confirmation silently
Cool effects in games
Scrolling and swiping
Tissue vs. bone in surgery
 Two Types of Touch Feedback
– Tactile Feedback on touch surfaces
and touch screens
– Force Feedback on physical devices
(eg. steering wheels, joy sticks,
rotary knobs, surgical tools)
© 2010 Immersion Corporation–Confidential
12
Large and Rapidly Growing Markets
Touch Screens and Surfaces Driving Haptic Adoption
Automotive
Mobile Phone
•
•
•
•
•
Multimodal UX
Virtual Keyboard
Gaming
Personalized Alerts
Immersive Messaging
1.2B PHONES
Infotainment
Navigation
Climate Control
X by Wire
•
•
•
•
52M VEHICLES
Consumer
•
•
•
•
•
•
•
Personal Computer
Personal Navigation Device
Personal Media Player
Home Automation
White Goods
Camera
Printer
400M DEVICES
Medical
Gaming
Commercial
• Robotic Surgery
• Medical Device
• Medical Simulation
•
•
•
•
•
•
•
•
•
•
15M DEVICES
Controllers
Handheld
Arcade
Casino
70M DEVICES
© 2010 Immersion Corporation–Confidential
Desktop Phone
Office Printer
Point of Sale
Fitness
Portable Data Terminal
Industrial Control
400M DEVICES
13
M of Units
Haptics Differentiates UX Across Array of Products
Source: Display Search, June 2010
© 2010 Immersion Corporation–Confidential
14
Touch Screen Adoption Fuels Haptics
Immersion in 20% of Touch Screen Phones in ‘09
M of Units
Haptic-enabled
Touch Screen Phones
31M
75M
Source: Display Search June 2010
© 2010 Immersion Corporation–Confidential
15
World Class Customers and Partners
Leveraging a Best-in-Class Ecosystem
OEM Customers and Brands
SemiSolution
conductor Component Integrator
Mobile
Gaming
Automotive
Medical
Commercial and Consumer
© 2010 Immersion Corporation–Confidential
Methode
Electronics
16
Compelling Value Proposition
Gaming
Mobile
CE
Commercial
Emotional Value
Automotive Medical
Functional Value

Transforms the User Experience

Improves Safety

Excites the Senses

Expands Usability

Restores “Mechanical" Feel
© 2010 Immersion Corporation–Confidential
17
Key Benefits of Haptics
Mechanical
Controls
Touch
Controls
Touch Controls
with Touch Feedback
Control Area
Efficiency
Long Term
Durability
User Experience
Industrial Design
Tactile
Satisfaction
Less Advanced
© 2010 Immersion Corporation–Confidential
More Advanced
18
TouchSense 2000 Series
®
Haptics for Mass Market Products
 Cost-effective Compelling Haptics Effects
 Drop-in Haptic Processor
 Streamlined Haptic Effects
 I/O Interfaces
 Lower Power Consumption
 Proven Mass Market
© 2010 Immersion Corporation–Confidential
19
TouchSense 2000 Series
Features
TouchSense 2000
TouchSense 2100
Haptic Effects Library
14
115
UI
Button-based
Screen-based
Button Effects
Simple Confirmation
Rich UI Support
Alert Effects
Limited
Yes
Gesture Effects
No
Yes
Custom Effects
No
No
I/O
12C, SPI, GPIO
I2C, SPI, GPIO
OS Support
No
No
Sample Products
Washers & Dryers
Professional-grade
Cook Tops
Refrigerators
Microwaves
Blenders
Consumer Printers
Personal Navigation
Devices
Personal Media
Players
Digital Cameras
Digital Video Cameras
IP Telephones
Multi-functional Printers
Point of Sale Devices
Consumer Medical Devices
© 2010 Immersion Corporation–Confidential
20
TouchSense® 2000 Series
Market Segments
PMP
Smartbook/
Netbook
Portable
POS
Digital Still
Camera
Multifunction
Printers
Portable
Medical
Kitchen
Appliances
White
Goods
Portable
Navigation
Device
IP Phone
Laptop
Tablet
© 2010 Immersion Corporation–Confidential
21
The TouchSense® Design Kit – 2000 Series
Part number: TS-DKIT-2000
 The TouchSense Design Kit – 2000 Series includes
electromechanical components and documentation that enables
OEMs, ODMs, and system integrator to quickly evaluate and
experience rich tactile feedback in small touch screen products.
 Kit Components include:
– Haptic Sampler Board
– Electromechanical Actuators
– Control Prototyping Modules
– Technical Documentation
Part number: TS-DKIT-2000
© 2010 Immersion Corporation–Confidential
22
Question
Question 1: What is the part number of the TS2000
Design Kit based on Renesas-Immersion
solution?
Answer:
TS-DKIT-2000
© 2010 Immersion Corporation–Confidential
23
Why Inertial Actuation?

Suitable for small screen
applications

Compact form factor

Low Power

Low Component Cost, Driven by
High Volumes

Multiple Suppliers

Good Haptic Performance

Proven Technology in tens of
millions of Mobile Phones
© 2010 Immersion Corporation–Confidential
24
Haptic Effects Library
“Plug and Play" Effect Library

Designers can select over 100 compelling haptic effects through a single
command API that are tailored to a range of User Interface elements
including:
– Touch Gestures:
 Tap
 Double-tap
 Swipe
 Spread
 Pinch
 Slide/drag
 Long press
– Scrolling through lists
– Alert
– Click
– Buzz
– Transitions
– Pulse
© 2010 Immersion Corporation–Confidential
25
TS200 Series
Mechanical Overview
© 2010 Immersion Corporation–Confidential
26
Suspension Design Process
 Determine suspension type based on
hardware type
 Determine actuator to use based on
hardware mass
 Design suspension based on points above
 Test and reiterate as needed for consistent
touch playback
© 2010 Immersion Corporation–Confidential
27
Screen Suspension Type
Two scenarios:
– Haptic effects isolated to screen (desktop, in-dash, large
screens)
 need relative motion between TS/display & housing
–
Haptic effects coupled to screen & housing (hand-held devices)
 need stiff connection to all housing
Bezel
Bezel
Touch Screen
Touch Screen
Display
Actuator (ERM )
top view down shaft
Display
PCB
PCB
Actuator (ERM ) top view down shaft
Bezel sealing foam
Screen-backing suspension grommet
Screen-Isolated Haptics
Bezel sealing
foam
Back cover / case
Low-damping
(elastic) foam
Whole-Device Haptics
Note: Exact mechanical configuration is application specific.
© 2010 Immersion Corporation–Confidential
28
Non-Suspended Haptics System Response
Bezel
Haptics on entire
system
Touch Screen
Display
PCB
Bezel/sealing
Sealing foam
Actuator
Low-damping
(elastic) foam
Back cover
Whole-Device Haptics
Touchscreen
Acceleration
Prototype System Acceleration
Button-click Effect
© 2010 Immersion Corporation–Confidential
Housing
Acceleration
29
Suspended Haptics Response System
Haptics mostly on
screen only
Bezel
Touch Screen
Display
PCB
Actuator (ERM ) top view down shaft
Bezel sealing foam
Screen-backing suspension grommet
Screen-Isolated Haptics
Touchscreen Accel.
Prototype System Acceleration
Button-click Effect
© 2010 Immersion Corporation–Confidential
Housing Accel.
30
Whole Device vs. Suspended Screen
Suspension
Type
Device Mass
≤ 150 g
Touch
Surface
Mass
---
Recommended
Actuator
Sanyo NRS-2574i
--Jinlong
100-200 g
TS2000/TS2100
Actuator
Z6DL2A017000B
Whole
Johnson Electric
--Device
150-300 g
Selection
09J4015
3.3V
3.3V
5.0V
---
Contact your
Immersion Rep
---
≥ 225 g
Up to 75 g
Sanyo NRS-2574i
3.3V
≥ 450 g
50-150 g
Jinlong
Z6DL2A017000B
3.3V
≥ 600 g
150-225 g
Johnson Electric
09J4015
5.0V
---
Beyond 225 g
Contact your
Immersion Rep
---
>300 g
Suspended
Screen
Drive
Voltage
© 2010 Immersion Corporation–Confidential
31
Grommet Suspension Overview
 ME
Team has put much effort into the development of
grommets for Floating Screen Actuation. Advantages
over foam include:
• Ease of Assembly
• Easily Customizable
• Shock Protection
Immersion C1 Grommet
• Consistency
© 2010 Immersion Corporation–Confidential
32
Grommet Suspension Example - DTS
Carrier
Actuator
Bonded to
Carrier
(DTS = Display + Touch Screen)
Carrier
Device Chassis
Grommet &
Hardware
Inserts into
Carrier Mounts
on post
LCD/Touchscreen
bonded to carrier
Foam Dust seal
bonded to
chassis only
© 2010 Immersion Corporation–Confidential
Grommet Post
molded into
chassis
33
TS2000 Series
Electrical Overview
© 2010 Immersion Corporation–Confidential
34
TS2000 Basic Components
Motor Driver
Amplifier
Customer
Interface
Protection
circuit
Controller
(J1)
Actuator
© 2010 Immersion Corporation–Confidential
35
Haptic Sampler Board
© 2010 Immersion Corporation–Confidential
36
TS2000 Control Prototype Module Board Overview
P
r
o
t
e
c
t
i
o
n
Controller(R8C MCU)
Actuator
Driver
(TPA6205)
HSB
Interface
Customer Interface
© 2010 Immersion Corporation–Confidential
37
Haptic Effect Descriptions
Triggered via an I2C / SPI / GPIO
GPIO index
SPI message
I2C message1
Haptic Effect Description
0
0x00 0x00
0x00 0x00
Strong Click
1
0x01 0xFF
0x01 0xFF
Med Strong Click 60%
2
0x02 0xFE
0x02 0xFE
Low Strong Click 30%
3
0x03 0xFD
0x03 0xFD
Sharp Click
4
0x04 0xFC
0x04 0xFC
Sharp Click 60%
5
0x05 0xFB
0x05 0xFB
Sharp Click 30%
6
0x06 0xFA
0x06 0xFA
Soft Bump
7
0x07 0xF9
0x07 0xF9
Med soft Bump 60%
8
0x08 0xF8
0x08 0xF8
Soft Bump 30%
9
0x09 0xF7
0x09 0xF7
Double-Click
10
0x0A 0xF6
0x0A 0xF6
Double-click 60%
11
0x0B 0xF5
0x0B 0xF5
Triple-Click
12
0x0C 0xF4
0x0C 0xF4
Soft Fuzz
13
0x0D 0xF3
0x0D 0xF3
Strong Buzz
14
0x7E 0x82
0x7E 0x82
Play firmware revision number
15
0x7F 0x81
0x7F 0x81
Abort Effect Playback. Any currently-playing effect is
immediately aborted.
© 2010 Immersion Corporation–Confidential
38
Triggering Haptic Effect with TouchSense
4V
3V
0V
- 4.5V
0 -50 MS
© 2010 Immersion Corporation–Confidential
0 -50 MS
0 -50 MS
39
Demo System Configuration
I/O
Backlight
Control
Buzzer
Speaker
Serial I/F
Touch
Keys
R8C/33T
PWM
Wake-up
(I/O)
Serial
I/F
R8C
PWM
LED’s
H8SX/1668R
DDLCD
I/F *
Touch Screen
Resistive
Touch
I/F
Mechanical
Connection
Amplifier
Actuator
4.3” WQVGA
Sharp LCD Panel
Haptics
© 2010 Immersion Corporation–Confidential
* External memory buffer omitted for simplicity
40
Question
Question 2: What are the two screen suspension
types for haptic implementation?
Answer:
Screen-Isolated and Whole-Device haptics
© 2010 Immersion Corporation–Confidential
41
Questions?
© 2010 Immersion Corporation–Confidential
42
Innovation
The TouchSense System Components Include:

TouchSense Player

Off-The-Shelf Actuator

Tactile Effects Library for Common TouchScreen Actions
© 2010 Immersion Corporation–Confidential
43
Thank You
© 2010 Immersion Corporation–Confidential
44
Appendix
© 2010 Immersion Corporation–Confidential
45
Grommet Suspension Example - TSO
(TSO = Touch Screen Only)
Touchscreen Bonded to carrier
LCD attached to
system chassis
Foam Dust seal
bonded to LCD only
compressed by carrier
Grommet & Grommet Post
(molded into carrier)
System foam
perimeter seal
(optional)
© 2010 Immersion Corporation–Confidential
46
46