資訊科技與創新及競爭優勢
Gartner’s Hype Cycle Technology報告
Gesture Control
(手勢控制)
指導教授：徐立群 教授
2015/11/29
楊國雄 R07034291
洪美麗 R07034356
曾健哲 R07034429
*黃裕培 R07004026
Hype Cycle for Emerging Technologies 2015
2
Enlightenment
 Facebook’s Oculus buys gesture control firm Pebbles.
(2015/07)
 Sony acquires Softkinetic gesture recognition company.
(2015/10)
3
Enlightenment
 Google's gesture control technology will revolutionize the way
we use devices. (2015/06)
Soli chip at Google I/O.
Soli measures radar reflections to determine gestures.
Interact smartwatch without touching the device.
4
What is “Gesture Control” ?
 Gesture Recognition(手勢辨別) is a topic in
computer science and language technology with the
goal of interpreting解讀 human gestures via
mathematical algorithm [1].
 It is possible to point a finger at the computer screen
so that the cursor will move accordingly. This could
potentially make conventional input devices such as
mouse, keyboards and even touch-screens redundant.
5
How?
 Can be 2D-based or 3D-based.
 Beams an invisible infrared light on the individual and
reflected back to a camera and onto a gesture
recognition Integrated Chip (IC).
 Using gesture recognition software, creates a depth
map of the images and responds to the movements.
 No physical contact is required between the
individual and the gesture recognition-enabled device.
6
Input Devices
 Wired gloves (1986) [2]
 Depth-aware camera (2004) [3]
7
Input Devices
 Controller-based gestures (2008, 2011) [4, 5]
 Radar (Google Project Soli 2015) [6]
8
Algorithm
 3D model-based
 Skeletal-based
 Appearance-based
9
Application Areas
 Automotive
 Consumer Electronics
 Gaming
 Aerospace and Defense
 Healthcare
 Retail
10
Top Gesture Recognition Companies
11
Top Gesture Recognition Companies
 Face recognition
 Biometric eye identification
 Camera-enabled entertainment
 3D vision
 Vision processing IP
 Gesture recognition IP
 Medical imaging viewers
12
Top Gesture Recognition Companies
 Controller provider
 CPU with gesture recognition
 Motion sensors and hardware
 Infrared (IR) sensor
 Ultrasonic touchless gesturing
 Radar sensor (soli chip)
 Interaction system
13
Top Gesture Recognition Companies
 Face recognition
 Biometric eye identification
 Camera-enabled entertainment
 3D vision
 Vision processing IP
 Gesture recognition IP
 Medical imaging viewers
14
Face recognition
"Cognitec Systems was founded in 2002 by a team of experts who
recognized the growing need for software solutions in the field of
biometrics. Our founders have been working on algorithms for the
FaceVACS face recognition technology since 1995. Starting in
1996, government and industry customers have relied on the
FaceVACS technology for a wide range of applications. The
development of our products and the growth of our company build
on the extensive knowledge of our scientists and software
engineers and their continuing dedication to deliver the best
performance available on the market."
15
Biometric eye identification
“Cross Match Technologies, Inc. is a leading innovator and
provider of biometric identity management solutions to
governments, law enforcement agencies, and businesses around
the world. Cross Match delivers a comprehensive facial
recognition suite, which includes: Lookout Collector to rapidly
capture facial images from video footage 鏡頭 and surveillance 監
控 tapes, Lookout Matcher to reliably locate and extract facial
images from video footage for watch list comparison and Lookout
Verify facial recognition SDK, which enables the real-time
verification of ID photos.”
16
Biometric eye identification
"IrisGuard Technology is based on the science that every human
eye is different, providing a unique identifier for every person in
the world. It uses the varied characteristic of the human iris鳶尾花
and delivers accurate, fast and secure biometric personal
identification solutions. IrisGuard EyeBank® solution includes
IrisGuard cameras, software and backend servers that scan the
iris and immediately compares it with every record in the bank
database to give an accurate and reliable authentication."
17
Top Gesture Recognition Companies
 Face recognition
 Biometric eye identification
 Camera-enabled entertainment
 3D vision
 Vision processing IP
 Gesture recognition IP
 Medical imaging viewers
18
Camera-enabled entertainment
"GestureTek™ is the inventor, pioneer, multiple patent-holder and
world-leader in camera-enabled gesture-recognition technology
for presentation and entertainment systems. Back in 1986, we
invented and shaped the field of 'applied computer vision' for
computer-human interaction, and have continued inventing new
video gesture control technologies ever since. The company's
multi-patented video gesture control technology (VGC) lets users
control multi-media content, access information, manipulate
special effects, even immerse themselves in an interactive 3D
virtual world – simply by moving their hands or body. We deliver
Wii-like gesture-control without the need to wear, hold or touch
anything."
19
Camera-enabled entertainment
Handpose, a new innovation by Microsoft Research, could make
all that possible, giving computers the ability to accurately and
completely track the precise movement of your hands through a
Microsoft Kinect, right down to the finger wiggle.
Microsoft has started to bring gesture control to its Windows
Phone devices with a newly released app.
20
3D vision
"SoftKinetic is the leading provider of end-to-end, 3D vision for
PCs, portable electronics and machines. 3D vision is used in
everything from gesture-control to context awareness. Personal
devices can be given the ability to understand ever more about
the user, their surroundings and their environment. More than ten
years of R&D has gone into developing this unique blend of 3D
vision, gesture recognition, and context awareness technology."
21
Top Gesture Recognition Companies
 Face recognition
 Biometric eye identification
 Camera-enabled entertainment
 3D vision
 Vision processing IP
 Gesture recognition IP
 Medical imaging viewers
22
Vision processing IP
“CogniVue's provides revolutionary gains in embedded vision
processing performance per power through multi-tier innovation in
vision processing, APEX processing IP itself (massively parallel
and power-efficient), APEX Core Framework, which enables 100x
gains in the processing of complex algorithms, and high level
vision expertise providing added value to our customers'
customers. CogniVue has focused on building industry alliances
(e.g. Embedded Vision Alliance) and collaboration with solution
partners, suppliers, and universities. CogniVue is innovating with
vision, enabling new and revolutionary vision-based applications.”
23
Gesture recognition IP
“eyeSight was founded in 2005 with the vision of revolutionizing
the way people interact with digital devices. As part of this vision
eyeSight brought natural human interfaces to countless devices,
becoming a leading provider of gesture recognition technology.
eyeSight is headquartered in Israel, with global offices located in
the U.S., Korea, Hong Kong, and Japan. The company is led by a
team of highly experienced Image processing professionals, with
extensive expertise in research, implementation, and optimization
of real time algorithms for embedded platforms.”
24
Gesture recognition IP
"At Omek, we are changing the way people interact with their
devices. Omek’s innovative gesture recognition technology
provides you with fast, accurate, and easy-to-use tools to add
gesture recognition and motion tracking to your applications. Our
technology is being incorporated into a vast range of devices –
from TVs, and game consoles, to PCs, tablets, notebooks,
smartphones and automotive infotainment systems. The gestureenabled applications running on these devices are as far-ranging
reaching as games, 3D design and visualization, operating
systems, and beyond."
25
Gesture recognition IP
“The Creative* Interactive Gesture Camera Developer Kit is a
small, light-weight, USB-powered camera optimized for closerange interactivity. Designed for ease of setup and portability, it
includes an HD webcam, depth sensor and built-in dual-array
microphones for capturing and recognizing voice, gestures and
images. The Camera, when paired with the Intel® Perceptual
Computing SDK Beta 2013, enables developers to create the next
generation of natural, immersive, innovative software applications
that incorporate close-range hand tracking, speech recognition,
face analysis and 2D/3D object tracking.”
26
Gesture recognition IP
"PointGrab is a leader in advanced gesture recognition software
solutions offering a natural and intuitive way of interacting with
consumer devices. PointGrab’s software solution enables any CE
device including TVs, PCs, Tablets, and Smartphones to be
operated by gesture control using finger, hand and two hands
shapes and movements while using a standard camera.
PointGrab‘s market-leading solutions have been commercially
available since 2010 and are currently integrated into millions of
consumer devices through many of the world’s top OEMs, brands
and developers."
27
Top Gesture Recognition Companies
 Face recognition
 Biometric eye identification
 Camera-enabled entertainment
 3D vision
 Vision processing IP
 Gesture recognition IP
 Medical imaging viewers
28
Medical imaging viewers
“The GestSure system uses advanced sensors that allow the
surgeon外科醫生 to access their imagery through simple hand
gestures. From their operating table position, the surgeon
employs a simple set of gestural commands that allows them to
do anything they would with a conventional mouse. And as
advanced as GestSure's technology is, to the operating room
computer it's no different than a standard USB input device. That
means there's no need to install special software or drivers, and
requires minimal hospital IT support. In fact, it's compatible with all
medical imaging viewers, today.”
29
Top Gesture Recognition Companies
 Controller provider
 CPU with gesture recognition
 Motion sensors and hardware
 Infrared (IR) sensor
 Ultrasonic touchless gesturing
 Radar sensor (soli chip)
 Interaction system
30
Controller or CPU provider
"Microchip Technology Inc. is a leading provider of microcontroller
and analog semiconductors, providing low-risk product
development, lower total system cost and faster time to market for
thousands of diverse customer applications worldwide.
Headquartered in Chandler, Arizona, Microchip offers outstanding
technical support along with dependable delivery and quality."
31
Controller or CPU provider
“Qualcomm Incorporated (NASDAQ: QCOM) is the world leader in
3G and next-generation mobile technologies. For more than 25
years, Qualcomm ideas and inventions have driven the evolution
of wireless communications, connecting people more closely to
information, entertainment and each other. Gesture recognition
technology will be integrated into Qualcomm’s current and nextgeneration Snapdragon™ processors, giving OEMs the capability
to produce smartphones, tablets and home entertainment devices
with user interfaces based on natural human gestures.”
32
Top Gesture Recognition Companies
 Controller provider
 CPU with gesture recognition
 Motion sensors and hardware
 Infrared (IR) sensor
 Ultrasonic touchless gesturing
 Radar sensor (soli chip)
 Interaction system
33
Sensors
“We are Pebbles Interfaces. We are here to revolutionize the way
people interact with the digital world. Our technology provides an
entirely new meaning to simple and natural human gestures, by
unifying the interfaces on any device or platform, be it a
smartphone, PC, smart TV, or even a coffee table surface — from
any distance. We develop advanced motion sensors that display
physical objects within the digital space, at any range or angle,
with no latency. Pebbles’ minimal hardware is being embedded in
our partners’ smart products and devices.”
34
Sensors
"Pyreos' unique and minaturised, passive Infrared (IR) sensor
technology is enabling highly accurate, low powered touchless
gesture control within mobile consumer products. Crucially, for the
first time within the industry, Pyreos' core technology excels in
delivering the key features of outstanding accuracy coupled with
low battery consumption making it ideally placed for integration
within battery-powered, consumer electronic devices like mobile
phones and tablet PCs."
35
Sensors
“Elliptic Labs is a privately held company with offices in Palo Alto,
California, and Oslo, Norway. Started in 2006 as a spinoff from the
signal processing environment at the University of Oslo, Elliptic
Labs grew from our initial research background in echomanagement systems for multi-antenna mobile communication.
Elliptic Labs is on a mission to deliver robust natural touchless
gesturing that is adaptive to the human style of interaction. We are
accomplishing this by enabling ultrasonic touchless gesturing for
all PCs, tablets and smartphones to be used anywhere-anytime!”
36
Top Gesture Recognition Companies
 Controller provider
 CPU with gesture recognition
 Motion sensors and hardware
 Infrared (IR) sensor
 Ultrasonic touchless gesturing
 Radar sensor (soli chip)
 Interaction system
37
Interaction system
“Led by mechatronics機電一體化 engineers Stephen Lake,
Matthew Bailey, and Aaron Grant, we're a world-class team of
engineers, researchers and designers building the future of
human-computer interaction. We're closing the gap between
humans and technology by solving a fundamental question: How
do we connect the real and the digital worlds as we move towards
wearable and ubiquitous computing? We have big plans, and
world-class investors backing them.”
38
Next
 Transparency Market Research--The global gesture recognition
market was valued at US$7.5 billion in 2014 and is anticipated to
reach US$29.1 billion by 2021, at a CAGR of 20.3% from 2015 to
2021. [7]
 Global Industry Analysts--The global market for gesture recognition is
projected to exceed US$12.7 billion by 2020 in United State. AsiaPacific ranks as the fastest growing market with a CAGR of 53.1%
from 2013 to 2020. [7]
**Figure sources: [8]
**Figure sources: [8]
39
Gesture Recognition Market Forces
**Figure sources: [8]
40
Gesture Recognition Market Competition
**Figure sources: [8]
41
REFERENCES
[1] Gesture recognition. Available: https://en.wikipedia.org/wiki/Gesture_recognition
[2] T. G. Zimmerman, J. Lanier, C. Blanchard, S. Bryson, and Y. Harvill, "A hand
gesture interface device," SIGCHI Bull., vol. 18, pp. 189-192, 1986.
[3] L. Yang and J. Yunde, "A robust hand tracking and gesture recognition method for
wearable visual interfaces and its applications," in Image and Graphics (ICIG'04),
Third International Conference on, 2004, pp. 472-475.
[4] T. Schl, #246, mer, B. Poppinga, N. Henze, and S. Boll, "Gesture recognition with a
Wii controller," presented at the Proceedings of the 2nd international conference on
Tangible and embedded interaction, Bonn, Germany, 2008.
[5] (2012). Gestural Control of Sound Synthesis: Featured Question. Available:
https://www.percussa.com/2012/10/04/gestural-control-of-sound-synthesis-featuredquestion
42
REFERENCES
[6] (2015). Welcome to Project Soli. Available: https://www.google.com/atap/projectsoli/
[7] (2015). Global Gesture Recognition Market to Log 20.3% CAGR to Exceed US$29
bn by 2021: Transparency Market Research. Available:
http://www.prnewswire.com/news-releases/global-gesture-recognition-market-to-log203-cagr-to-exceed-us29-bn-by-2021-transparency-market-research-551351821.html
[8] (2015). Gesture Recognition Market Trends - Global Industry. Available:
http://www.strategyr.com/MarketResearch/Gesture_Recognition_Market_Trends.asp
43
Videos
[a] Pebbles: https://www.youtube.com/watch?v=WkddF7F0zvs
[b] Google: https://www.google.com/atap/project-soli/
[c] Microsoft: https://www.youtube.com/watch?v=QhLAq3uDEkM
[d] Intel: https://www.youtube.com/watch?v=DuUVIat40YU
[e] GestSure: https://www.youtube.com/watch?v=wUEEsYH0zUE
[f] ellipticlabs: http://www.ellipticlabs.com/?page_id=3107
[g] Myo: https://www.youtube.com/watch?v=te1RBQQlHz4
44
Thank you!
45