NUI: The Natural User Interface
Multi-Touch
Capable
Gesture Capable
Voice Capable
Neural Capable
• Common Gestures of Touch
• Physical Object Interaction
• Virtual Object Interaction
• Motion Based Interface
• Tracking of full-body movement, facial expression, and voice with
precision
• Multi-array Microphone
• Uniquely Distinguish Audio & Voices
• Conscious and non-conscience interfaces
• Non Invasive
A little bit about me and why I am here…
InterKnowlogy (www.InterKnowlogy.com)
Tim Huckaby, Founder/Chairman (TimHuck@InterKnowlogy.com)
13+ year old services firm – Custom Application Development
focused on building NUI solutions
Web, mobile, and desktop
windows 7/8, Surface, Windows phone 7, azure, Kinect,
Largest Client: Microsoft
Actus Interactive Software (www.Actus-Software.com)
Tim Huckaby, Founder/CEO (TimHuck@Actus-Software.com)
Software Product Company
Interactive Kiosk and Active Digital Signage
Multi-Touch, Gesture, and Voice Driven Solutions
The “Green-Screen”
Image courtesy of Computer History Museum
The Samsung SUR40 for
Microsoft Surface
Windows 8 - Metro
1972: PLATO IV Touch Screen
Terminal
Apple iPad
Past
Present
Future (Now)





Inexpensive Touch Capable, Non Proprietary
Hardware
A Windows OS designed for Multi-Touch
A Consistent Multi-Touch API for .NET across
all Windows Hardware/Software Platforms
Developer Productivity in Touch Capable
Apps
The Forecast of Multi-Touch Hardware
Capability in Every New Computing Device in
the Short Term
About the Windows 7 Computer I am Using Today…
HP TouchSmart TM2
Rates in Windows as 5.0
Price in October-2010: Starting from: $1499.99*
Price in March-2011: Starting from: $799.99*
Price Today (HP TouchSmart 320m ): $579.99
HTML 5 Touch Events Spec, Version 2
W3C Editor's Draft 14, November 2011
 Defines a set of low-level events that
represent one or more points of contact with
a touch-sensitive surface
 Changes of those points with respect to the
surface and any DOM elements displayed
upon it (e.g. for touch screens) or associated
with it (e.g. for drawing tablets without
displays).
 Addresses pen-tablet devices, such as
drawing tablets, with consideration toward
stylus capabilities.
Source: https://dvcs.w3.org/hg/webevents/raw-file/tip/touchevents.html




The Microsoft Surface is expensive
because it has 5 cameras looking up
that do Object Recognition
Based on a “byte tag” (not a QR code)
Object Recognition in Windows
The Use Cases are limitless…
NUI: Games as a Tool for Learning
Learning made Fun / Entertaining
Proven as a learning tool beyond just Children
Computer based Games are a significant part of popular
culture
Educational Video Game Curriculums
MIT, UC Irvine, Minnesota, Mich State, etc.
NASA: Mars Bound
Windows 8
Metro -
Actus Interactive Kiosk
Touch-less OR
IK PT
The Good News:
The Kinect SDK for Windows
The Not So Good News:
Windows Only Device; K4W does not work on your Xbox; you
cannot build apps for 18 million Xbox Kinect owners with it.
•
•
•
•
High fidelity EG acquisition device
No conductive gel, etc.
Non-invasive
Use Case Examples:
• Conscious: mind manipulation of objects
• Conscious: Steering a wheel chair with your mind
• Non-Conscious: Ranking music
• First target market: gaming
• $300!!!
SDK)
 Direct API access to all Emotiv detection suite inputs and controls,
including training, profile management and gyro outputs
 Program in C++ and compatible languages, .NET (VB.NET, C#), Java
 Developer plug-in available for Unity3D
 Active developer community (exclusive Developer user forum)
Summary
*Tool Bench “Chalk Talk” area at DEV track booth.
Monday, June 11, between 6:00pm and 7:00pm.
More info on InterKnowlogy:
www.InterKnowlogy.com
Silverlight.InterKnowlogy.com
www.vimeo.com/InterKnowlogy
More info on Actus Software:
•
E-mail: TimHuck@InterKnowlogy.com
TimH@Actus-Software.com
•
www.Actus-Software.com
About Tim Huckaby…
Contact me: Tim Huckaby
Founder/Chairman, InterKnowlogy
Founder/Chairman, Actus Software
Microsoft® Regional Director – Southern California
Microsoft® .NET Partner Advisory Council Founder /
Member
Microsoft® MVP - .NET
INETA Speaker – International .NET Users Group
Association
Board Member: Association for Competitive Technology
Board Member: Dev Connections
Author / Speaker
Phone:
Office: 760-444-8640
Mobile: 619 990 9200
Blog: http://team.interknowlogy.com/blogs/timhuckaby
FaceBook:
http://www.facebook.com/Tim.Huckaby.Carlsbad
LinkedIn:
http://www.linkedin.com/in/timhuckaby
Twitter: @TimHuckaby
Subtitle color
www.microsoft.com
http://northamerica.msteched.com
www.microsoft.com/learning
http://microsoft.com/technet
http://microsoft.com/msdn