ASLLENGE
Midway Design review
Dec 2 2011
He Zhou
Hui Zheng
William Mai
Xiang Guo
Advisor: Professor Patrick Kelly
Department of Electrical and Computer Engineering
Outline









Project Overview
MDR Specifications
Project Progress
Software Implementation
Hardware Implementation
Design Spec
Team Roles
Timeline
Q/A
Department of Electrical and Computer Engineering
Project Overview
Department of Electrical and Computer Engineering
Project Progress
 MDR goals reached:
• Hand tracking
• Some gestures recognition
• Basic GUI functional
• A internal testing database
• Functioning microcontroller
Department of Electrical and Computer Engineering
System Requirements (Revised)
 Motion Tracking:
• Track upper human body
• Recognize different human gesture
• Translate ASL to English word
 Microcontroller:
• Accurate A/D conversion
• Reliable communication with chosen output interface
 Graphical User Interface:
• Real-time operation
• Display text feedback
 Cost
• Below $500.
Department of Electrical and Computer Engineering
Software Design Flow
Department of Electrical and Computer Engineering
GUI Design Progress
 Achieved Goals
• Created a User Interface window
• Display translated text
• Display skeletal image
 Future Goals/Expandable
• 3D Avatar
• Voice recognition
• Tutorial
Department of Electrical and Computer Engineering
Test Database of body parts
 Created a hierarchical tree data structure
 Nodes contain information including:
• Area of tracking
• Location of next motion
• word associated with it
Department of Electrical and Computer Engineering
Hardware Implementation
 Increasing the resistance
of the flex sensor with
bend
 Analog signal input to an
Arduino Mega 2560
 The Arduino Mega 2560
works as an AD converter
 PC captures the signal via
USB or Bluetooth
Flex Sensor Glove
Arduino Mega 2560
Department of Electrical and Computer Engineering
9
More detail for Implementation
Vin
 Impedance buffet with relation
at
 Digital number display on the
Ardunio software is equal to
R1
Flex Sensor
R2
-
 Experimental result is almost
linear from 0 to 5 volts
Impedance Buffer
Experimental
Result
Digital Number
Arduino reading
Vout
+
1500
1000
500
0
0
2
4
6
Input Volatge to Anolaog
Pin(V)
Department of Electrical and Computer Engineering
8
Cost of Major Components
Name of
Component
Flex
Arduino
Sensor Mega 2560
A Pair of
Gloves
Kinect
Sensor
Bluetooth
Module
Quantities
10
1
1
1
1
Unit Price
$12
$56
$10
$150
$20
Total Price
Department of Electrical and Computer Engineering
$356
11
Team Roles
 He Zhou(CSE): test and integrate software
prototype
 Hui Zheng(CSE): database development and
programming
 William Mai (EE): build microcontroller to detect
finger and palm movements
 Xiang (EE): build Arduino board, overall testing,
building ASL database, and website
administration
Department of Electrical and Computer Engineering
12
CDR Deliverables
 Complete and expand basic databases for both
finger tracking and upper body tracking.
 Complete the finger tracking module.
 Build a fully functioning system prototype.
Department of Electrical and Computer Engineering
Timeline
10/16/2011
12/5/2011
1/24/2012
3/14/2012
5/3/2012
PDR
Purchase Parts
Planning
GUI
Interface with the Sensors
Build Finger Sensors
Build Test Database
Prototype 1
MileStone MDR Deliverables
System Integration
Winter Break
Expand Database
Prototype 2
MileStone CDR Deliverables
Alpha Testing
Update
Beta Testing
Spring Break
Finalize Project
MileStone FRP Deliverables
Department of Electrical and Computer Engineering
14
Q&A
Department of Electrical and Computer Engineering
15