COMIT
CRITICAL DESIGN REVIEW
CONTENTS
• Motivations
•
•
•
•
•
• Structural System Overview
Mission
Overview
Stakeholders
Sponsors
Team Organization
• Drawings
• Budget
• Risks & Impacts
• Electrical System Overview
•
•
•
•
•
Functional Decomposition
Environmental Circuit Overview
Image Sensing Overview
Data Processing Overview
Application Framework
•
•
•
•
Economic Impacts
Risk Mitigation and Safety
Environmental Impacts
Societal Impact
• Schedule
• Gantt Chart
• Milestones
Presenter: Nate Turley
Capstone Senior Design 2012
COMIT TouchSystems
2
MISSION
“The mediocre teacher tells. The good
teacher explains. The superior teacher
demonstrates. The great teacher inspires.”
― William Arthur Ward
Our mission is to inspire students in a way
that defies conventions of the classroom,
engaging them in the sights, sounds, and
kinesthetic of a new experience.
Presenter: Jenny Cofer
Capstone Senior Design 2012
COMIT TouchSystems
3
OVERVIEW
• This project will provide a table-sized multi-touch
interface on which to run educational applications.
• Primary Foci:
• Exciting, dynamic, non-conventional learning
• Appeals to childlike curiosity
• Engages multiple users
• User-Centered Design
• Educates on math, science, and music
Presenter: Jenny Cofer
Capstone Senior Design 2012
COMIT TouchSystems
4
STAKEHOLDERS
"Consumer preference and motivation is far less
influenced by the tangible attributes of product and
service than the sub-conscious sensory and
emotional elements derived by the total experience."
Dr. Gerald Zaltman, Harvard Business School
Presenter: Jenny Cofer
Capstone Senior Design 2012
COMIT TouchSystems
5
SPONSORS
• “A leader in sustainable,
energy-efficient LED lighting”
• “Designers, fabricators,
architects, engineers and endusers have come to rely on
ACRYLITE® sheet products to
meet their unique challenges in
a broad range of market.”
Presenter: Jenny Cofer
Capstone Senior Design 2012
COMIT TouchSystems
6
TEAM ORGANIZATION
Team Member
Roles
Jenny Cofer
Project Manager
Jared Yenzer
Systems Engineer
Justin Barth
Hardware Engineer
Nate Turley
Software Engineer
Nate Glab
Structural Engineer
Presenter: Jenny Cofer
Capstone Senior Design 2012
COMIT TouchSystems
7
ELECTRICAL SYSTEM
OVERVIEW
JUSTIN BARTH
Presenter: Justin Barth
Capstone Senior Design 2012
COMIT TouchSystems
8
LEVEL 0
FUNCTIONAL DECOMPOSITION
Touch
Audio
Touch Table
Display
Legend
Input / Output
Power 120 V AC
9
LEVEL 1
FUNCTIONAL DECOMPOSITION
Touch
Touch
Sensing
Touch
Data
Touch
Utilization
Audio
Display
12 V
12 V
Environmental Sensors
Power
Supply
Legend
Input / Output
Power
Power 120 V AC
Data
10
LEVEL 2
FUNCTIONAL DECOMPOSITION
Touch
Touch Sensing
Acrylic
Surface
Touch Utilization
Image
Processing
System
Imaging
System
Audio
Application
Framework
IR LEDS
Display
Projector
12 V
Environmental Sensors
120V AC
12 V Power
Supply
Legend
Input / Output
Power
Power 120 V AC
Data
11
ENVIRONMENTAL SENSORS
SYSTEM OVERVIEW
JARED YENZER
Presenter: Jared Yenzer
Capstone Senior Design 2012
COMIT TouchSystems
12
ENVIRONMENTAL SENSORS
CAT32
LED DRIVER
CAT5114
Potentiometer
R in
LED STRIPS
Temperature
Sensor
I/O
Analog
Output
Proximity
Sensor
3.3 V
5V
Analog Output
Presenter: Jared Yenzer
Capstone Senior Design 2012
COMIT TouchSystems
13
PROXIMITY SENSOR
GP2Y0A21YK
SPECIFICATIONS
• Infrared Analog Sensor
• 25 Hz Sampling Rate
• 5V Supply
• Detecting Distance
• 10 to 80 cm
Presenter: Jared Yenzer
Capstone Senior Design 2012
COMIT TouchSystems
14
TEMPERATURE SENSOR
TMP36
SPECIFICATIONS
• Analog Sensor
• 5V Supply
• ± 2º Celsius Accuracy
• -40º C to +125º C Range
Presenter: Jared Yenzer
Capstone Senior Design 2012
COMIT TouchSystems
15
IMAGING SYSTEM
OVERVIEW
JARED YENZER
Presenter: Jared Yenzer
Capstone Senior Design 2012
COMIT TouchSystems
16
IMAGING SYSTEM
Proximity Sensor
& Temp Data
20 MHz CLK
ATXMEGA16D4
μController
I2C
BUS
I/Os to
Potenti
ometer
TCM8230
Camera
8 Lines Parallel
Camera Data
3.3 V
2.8 V
1.5 V
Presenter: Jared Yenzer
Capstone Senior Design 2012
COMIT TouchSystems
17
MICROCONTROLLER
ATXMEGA16D4
INPUTS/OUTPUTS
• I2C BUS
• Program Camera Reg.
• Image Size
• Color Options
• Shutter Speed
• I/O Pin for LED Circuit
• Control Potentiometer
• 12-Bit ADC
• Proximity Sensor
• Temperature Sensor
Presenter: Jared Yenzer
Capstone Senior Design 2012
COMIT TouchSystems
18
CAMERA
TCM8230
Inputs/Outputs
• Parallel Data Out
• D0 – D7
• I2C Bus
• Control Registers
• 30 FPS
• YUV Format (3 Bytes)
• Luminance (Y)
• Chrominance (UV)
• Sub-QCIF (128px x 96px)
Presenter: Jared Yenzer
Capstone Senior Design 2012
COMIT TouchSystems
19
PROGRAMMER
AVRISP MKII
SPECIFICATIONS
• Program AVR
• PDI 6 pin Interface
Presenter: Jared Yenzer
Capstone Senior Design 2012
COMIT TouchSystems
20
TESTING RESULTS
TEST BOARD
SOFTWARE
• Test Major Components
•
•
•
•
Microcontroller √
Camera
Voltage Regulators √
Proximity Sensors
• Drivers for MCU √
Presenter: Jared Yenzer
Capstone Senior Design 2012
COMIT TouchSystems
21
IMAGE PROCESSING
SYSTEM OVERVIEW
JUSTIN BARTH
Presenter: Justin Barth
Capstone Senior Design 2012
COMIT TouchSystems
22
FPGA IMAGE PROCESSING SYSTEM
8 Line Parallel Camera Data
Frame End
Touch Coordinates
in TUIO Format
RS-232
Horizontal End
GPIO
Camera Clock
Available Input
20MHz Clock
5v USB
Presenter: Justin Barth
Capstone Senior Design 2012
COMIT TouchSystems
23
FPGA
Altera DE0
INPUTS/OUTPUTS
• 72 GPIO pins
• RS-232 Serial Out
• 115,200 baud
• 50MHz
Presenter: Justin Barth
Capstone Senior Design 2012
COMIT TouchSystems
24
RS-232 TO USB ADAPTER
RS-232 to USB Adapter
INPUTS/OUTPUTS
• RS-232 on FPGA
• USB on Raspberry Pi
Presenter: Justin Barth
Capstone Senior Design 2012
COMIT TouchSystems
25
FPGA DATA SENT OVER RS-232
Presenter: Justin Barth
Capstone Senior Design 2012
COMIT TouchSystems
26
BLOB DETECTION ALGORITHM
For each luminance pixel in frame
if pixel ≥ brightness threshold
for neighbor in pixel neighbors
if neighbor is part of a blob
pixel is incorporated into that blob
if pixel not assigned a blob
pixel assigned to new blob
compare location of new pixel with blob parameters
determine left, right, top, bottom most points of blob
Draw boxes around each blob
Use center point of boxes to determine touch coordinates to send out
Presenter: Justin Barth
Capstone Senior Design 2012
COMIT TouchSystems
27
BLOB DETECTION ALGORITHM IN
MATLAB
Basic image of IR touch blobs
Image after processed
through Matlab algorithm
Presenter: Justin Barth
Capstone Senior Design 2012
COMIT TouchSystems
28
APPLICATION FRAMEWORK
OVERVIEW
NATE TURLEY
Presenter: Nate Turley
Capstone Senior Design 2012
COMIT TouchSystems
29
FUNCTIONAL DECOMPOSITION
TUIO Spec via COM port
Raspberry Pi
HDMI
5V
30
RASBERRY PI BOARD
Broadcom BCM2835 SoC
SPECIFICATIONS
• 700 MHz ARM11
• Overclocking
• Broadcom VideoCore IV
• OpenGL ES 2.0
• USBx2 via integrated Hub
• HDMI Video Output
• 5v, 700mA, 3.5 W
• OS: Raspbian
Presenter: Nate Turley
Capstone Senior Design 2012
COMIT TouchSystems
31
SOFTWARE
OpenFrameworks
• Open source c++ toolkit
• Game engine architecture
• Setup()
• Update()
• Draw()
• Built in event listener
• Custom Event Args
• Callbacks
• OpenGL ES 2.0
• Standard for embedded accelerated graphics
• Hardware floating point support
Presenter: Nate Turley
Capstone Senior Design 2012
COMIT TouchSystems
32
UML CLASS DIAGRAM
CRITICAL SOFTWARE COMPONENTS
Presenter: Nate Turley
Capstone Senior Design 2012
COMIT TouchSystems
33
APPLICATION FLOW CHART
Presenter: Nate Turley
Capstone Senior Design 2012
COMIT TouchSystems
34
PROJECTOR
ViewSonic PDJ5351
SPECIFICATIONS
• 23’’ Throw Distance
• 2500 Lumens
• 3000:1 Contrast Ratio
• $420
Presenter: Nate Turley
Capstone Senior Design 2012
COMIT TouchSystems
35
STRUCTURAL
SYSTEM OVERVIEW
NATHAN GLAB
Presenter: Nate Glab
Capstone Senior Design 2012
COMIT TouchSystems
36
TABLE STRUCTURE
Presenter: Nate Glab
Capstone Senior Design 2012
COMIT TouchSystems
37
TABLE STRUCTURE
Presenter: Nate Glab
Capstone Senior Design 2012
COMIT TouchSystems
38
INSIDE TABLE STRUCTURE
Presenter: Nate Glab
Capstone Senior Design 2012
COMIT TouchSystems
39
BUDGET
OVERVIEW
JENNIFER COFER
Presenter: Jenny Cofer
Capstone Senior Design 2012
COMIT TouchSystems
40
BUDGET
Item
Company
Unit Price
Quantity
Total Cost
$420
1
$420
$215 - $21.50
(estimated)
1, length
5m
$193
(estimated)
Rear Projection Acrylite
Sheet (diffuser)
$152.57 $15.26
1, 40x25in
$137.31
Endlighten T
Acrylic
(Polished)
Acrylite
$219.34 $21.93
1, 40x25in
$197.41
Plexiglas
Overlay
Home Depot
$109
1, 40x25
$109
Projector
IR LED Reel
Environment
alLights.com
Presenter: Jenny Cofer
Capstone Senior Design 2012
COMIT TouchSystems
41
BUDGET
Item
Unit Price
Quantity
Total Cost
Proximity Sensing Advanced
Board Final
Circuits
$33
1
$33
AVRISP
Microcontroller
Atmel
$56.64
1
$56.64
Proximity LEDs
Sparkfun
$1.35
48
$64.80
CMOS Camera
Sparkfun
$9.95
2
$19.90
Potentiometer
Mouser
$3.04
2
$6.08
LED Driver
Mouser
$2.48
2
$4.96
IR LED track
materials
Company
$50
Presenter: Jenny Cofer
Capstone Senior Design 2012
COMIT TouchSystems
$50
42
BUDGET
Item
Company
Unit Price
Quantity
Total Cost
Sound
System
Provided
1
1
N/A
Structural
Materials
Home Depot
Proximity
Sensing
Board Draft
Advanced
Circuits
$150
$33
1
Total
$33
$1,481.18
Presenter: Jenny Cofer
Capstone Senior Design 2012
COMIT TouchSystems
43
ECONOMIC ASPECTS
• Marketability of system:
•
•
•
•
Could decrease teachers needed (esp. special education)
Could supplement homeschooling
Could extend past an educational environment
Cost expected to decrease in mass production
Presenter: Jenny Cofer
Capstone Senior Design 2012
COMIT TouchSystems
44
RISKS & IMPACTS
OVERVIEW
JENNIFER COFER
Presenter: Jenny Cofer
Capstone Senior Design 2012
COMIT TouchSystems
45
ENVIRONMENTAL IMPACTS
• Acrylite is Green and LEEDs certified
• “We are committed to minimizing our environmental impact.
Operating under the Guiding Principles of Responsible Care®, we
strive to continuously improve our health, safety, and
environmental performances. Our goal is to improve the
environment by supplying sustainable and long-living acrylic
products to the green building sector and to all other markets we
serve.”
• Environmental Lights has A New Angle on Green
• “At EnvironmentalLights.com we believe in sustainable lighting
solutions that are energy-efficient and long-lasting, which lowers
energy use and minimizes the environmental impacts from
manufacturing and waste.”
Presenter: Jenny Cofer
Capstone Senior Design 2012
COMIT TouchSystems
46
RISK MITIGATION & SAFETY
• Temperature
•
•
•
•
Fans
Ventilation
Overall heat sensor (in LED circuit)
Temperature sensor on camera board / projector unit
• Dust
• Fans
• Devices accessible for cleaning
• Followed Component Specifications (linked below)
• Acrylic here
• IR LEDs here
• Followed UL Guidelines (linked here)
Presenter: Jenny Cofer
Capstone Senior Design 2012
COMIT TouchSystems
47
SOCIETAL IMPACT
• Defying educational conventions
• “Spoon feeding in the long run teaches us
nothing but the shape of the spoon” ~ E. M.
Forster
• Providing the alternative
• “It is the supreme art of the teacher to awaken
joy in creative expression and knowledge.~ Albert
Einstein
Presenter: Jenny Cofer
Capstone Senior Design 2012
COMIT TouchSystems
48
SCHEDULE
OVERVIEW
NATHAN GLAB
Presenter: Nate Glab
Capstone Senior Design 2012
COMIT TouchSystems
49
SCHEDULE
50
SCHEDULE
Date
Description
Sept. 25/27
Milestone 1
Oct. 16/18
PDR
Oct. 23/25
Functional Decomposition
Nov. 13/15
Milestone 2
Dec. 4/6
CDR
Jan. 15/17
Milestone 3
Apr. 16/18
Apr. 23/25
Deliverable





Materials Ordered
Have the Structure Assembled
Application Framework complete
Camera Driver set up
Matlab blob detection optimized





FPGA Implementation
Camera to FPGA integration
FPGA to CPU integration
Environmental Sensor Implementation
Software Application Implementation

Completed table with custom software running
Milestone 4
Expo
Presenter: Nate Glab
Capstone Senior Design 2012
COMIT TouchSystems
51
QUESTIONS?
Presenter: Jenny Cofer
Capstone Senior Design 2012
COMIT TouchSystems
52