SMART GOGGLES
Preliminary Design Review
To Chong
Ryan Offir
Matt Ferrante
James Kestyn
Advisor: Dr. Tilman Wolf
Electrical and Computer Engineering
Augmented Reality Goggle Application
An Example of Augmented Reality Goggle Application
Electrical and Computer Engineering
2
Project Overview
 Augmented reality vision technology
• Sensing a user’s location and direction of view
• Computing what to display in the user’s field of view
• Displaying the visual content without obstructing the
user’s view of real objects
 Simple, efficient, and functional smart goggle
• Sensor unit
• Intel Atom Processor
• Goggle-based display
Electrical and Computer Engineering
3
Design Layout
+
Sensor Board
GPS
UART
Compass/
Accelerometer
Gyro
Battery
Pack
TWI
USB
CPU
Sensor
Filter
Tunnel
Creek
Board
MCU
Memory
Sensor
Data
Intel
Atom
VGA
DISPLAY
OpenGL
System Block Diagram
Electrical and Computer Engineering
4
Conceptual System Design
Bird’s eye view of the system design as worn
Electrical and Computer Engineering
5
Hardware & Software Components
 Sensor board
•
•
•
•
GPS
Gyroscope
Compass/Accelerometer
AVR microcontroller
Sense location and direction of
view through a Kalman filter
∙ Kalman filter
 Intel Atom Processor – Tunnel Creek board
• Windows Embedded 7 OS
• OpenGL – API and graphical application
 Goggle - Provided by Microvision, Inc.
• VGA connection
 Battery Pack – 12V
Electrical and Computer Engineering
6
Sensor Board
 PCB
•
•
•
•
•
•
•
•
Size: 1 x 2.5 in
Consumes < 0.8 W @ 3.3 V
GPS - USART
Gyroscope, Compass, Accelerometer – I2C
USB-powered, 3.3V and 1.8V regulators
On-board 32-bit microcontroller
Design completed
Sending out this week
Electrical and Computer Engineering
7
GPS – MN1010
 USART connection to the microcontroller
 Determines the location of the user
 Features:
•
•
•
•
•
•
12-channel GPS receiver, RF filtering, flash memory
Operates at 1.8V @ 35mA
< 75 mW total power consumption
10mm x 10mm x 2mm, 36 pin LGA packet
Outputs NMEA-0183 string @ 1 PPS
Frequency: 1575.42 MH
Electrical and Computer Engineering
8
Gyroscope - L3G4200DTR
 I2C bus connection to the microcontroller
 Determines head orientation of the user
 Features:
• Operates at 3.3V @ 6.1mA
• Three-axis angular rate sensor
• X-axis: pitch axis
• Y-axis: roll axis
• Z-axis: yaw axis
• 16 bit-rate value data output
Electrical and Computer Engineering
9
Accelerometer/Compass - LSM303DLHC




Single I2C bus connection to the microcontroller
Accelerometer determines head movements
Compass determines the direction user is facing
Features:
•
•
•
•
•
3.3V @ 0.11 mA
3 magnetic field channels and 3 acceleration channels
From ±1.3 to ±8.1 gauss magnetic field full-scale
±2g/±4g/±8g/±16g selectable full-scale
3x5x1mm
Electrical and Computer Engineering
10
AVR Microcontroller - AT32UC3B0256-Z2UT
 High Performance, Low Power AVR®32 UC3 32-Bit
Microcontroller
 Executes > 1 MIPS / MHz
 Universal Serial Bus (USB) Bootloader
 Internal High-Speed SRAM, Single-Cycle Access at
Full Speed: 96KB (256KB Flash)
 Single Cycle Access up to 60 MHz
 Single 3.3V Power Supply
 Implements the Kalman Filter
Electrical and Computer Engineering
11
Kalman Filter
Electrical and Computer Engineering
12
Kalman Filter
 A recursive predictive algorithm
 Increases accuracy of noisy measurements
 Measurements: Gyroscope, Accelerometer,
Compass, GPS
 Inputs: Measurements, Previous State of
System, Bias Terms
 Outputs (State Vector): Location, Orientation
 Predicts the users location/orientation based
on previous values, measurements,
covariance, and noise
Electrical and Computer Engineering
13
Kalman Filter
Electrical and Computer Engineering
14
Intel Atom E680 – Tunnel Creek

Operates at 1.6GHz

Up to 2GB DDR2

1MB BIOS Flash, on-board
reprogrammable

VGA port

USB port

2 x SATA hard disk interface

2 x 1000 BaseT Ethernet ports

Small size – 75 x 65mm (What is
the size from Cornell????)

6W power consumption
(Cornell???)

Supply voltage: 5V (Cornell spec
please!!!)
Electrical and Computer Engineering
15
Software
 Windows Embedded 7 OS
 Develop 3D environment application with
OpenGL
 OpenGL allows us to easily update graphical
position
 Translate users movement and orientation
into a virtual environment to be used for 3D
graphic application
 API Development
Electrical and Computer Engineering
16
Picture example of openGL over image
Electrical and Computer Engineering
17
Picture example of openGL over image 2
Electrical and Computer Engineering
18
Goggle-Based Display




VGA connection port
Input image projected on corrective lens
Semitransparent reflective lens
To be provided by Microvision, Inc.
http://www.microvision.com
Electrical and Computer Engineering
19
Cost Schedule
Components
Price
Sensor board components $71.00
PCB Manufacturing
$150.00
Battery
$50.00
Intel Atom E680
$150.00
Total
$421.00
Electrical and Computer Engineering
20
Battery
 12VDC battery pack
Electrical and Computer Engineering
21
Proposed MDR Deliverables
 Demonstrate the orientation of the Sensor Unit
 Design a simple 3D environment using OpenGL
• PC version
Electrical and Computer Engineering
22
Questions
Electrical and Computer Engineering
23