AR Mobile Game Development
Getting Started
Jeff Chastine | Jon A Preston | Tony Tseng
What is
Augmented Reality
?
Reality
Reality
Virtual Reality
Reality
Augmented Reality
Virtual Reality
The kind of Augmented Reality we want to achieve here:
1) Combining Physical and Virtual World
2) Registering the Virtual Content with the Physical World in 3D
3) Being Interactive in Real Time
Augmented Reality
isn’t “new”
How is it done
?
Essential Components of an AR System
Sensors
Computer
e.g., phone, tablet, laptop
Determine View Location
e.g., eye or camera
AND
Render Virtual World
integrated w/ physical world
e.g., camera, GPS, touch, accelerometer,
compass
Display
Optical See-Through
e.g., transparent HMD
OR
Video See-Through
e.g., camera phone
The 2 Most Important Elements
TRACKING
RENDERING
TRACKING
ARToolkit
•
Dr. Hirokazu Kato
•
Free / Open source
•
General Public License
(GPL)
•
www.hitl.washington.edu/a
rtoolkit/
TRACKING
ARToolworks
•
ARToolworks
•
Commercial license
•
It has been ported to
many authoring
environments
•
www.artoolworks.com
TRACKING
ARToolkitPlus
•
Graz University of
Technology’s Christian
Doppler Lab
•
Free / Open source
•
General Public License
(GPL)
•
http://studierstube.icg.tugraz.ac.at/handheld_ar/arto
olkitplus.php
TRACKING
Stb Tracker
•
Imagination
•
Commercial license
•
More efficient and stable
•
http://studierstube.icg.tugraz.ac.at/handheld_ar/stb
tracker.php
TRACKING
2D NATURAL FEATURE
•
Graz University of
Technology’s Christian
Doppler Lab
•
Commercial license sold by
Imagination
•
http://studierstube.icg.tugraz.ac.at/handheld_ar/high
speed_nft.php
TRACKING
2D NATURAL FEATURE
•
Qualcomm Vuforia
•
http://www.qualcomm.com/s
olutions/augmented-reality
TRACKING
2D NATURAL FEATURE
•
Metaio
•
Commercial license
•
www.metaio.com
3D NATURAL FEATURE
TRACKING
•
Subject of active research
•
An area that is currently being
explored
•
Nothing robust commercially
available
Cellphones, Game
consoles
High-end
PDA
Tablet
Computer
Backpack
Computer
RENDERING
The power of personal computers
are now in phones
So we know how AR works.
Now what?
Let’s use it to make games!
Challenges
TECHNOLOGY
So we want to make
AR Mobile Games
Challenges
TECHNOLOGY
Challenges
TECHNOLOGY
Challenges
DESIGN
Something that is more than just a gimmick
Challenges
Putting Together a Team
The Roles of Game Development
Project Manager
Artist
Animator
Programmer
Level Designer
Sound Designer
Challenges
Putting Together a Team
NO, you can not JUST be
a Game Designer
Challenges
Artists vs Programmers
Artists vs Programmers
They think differently
Challenges
Artists vs Programmers
Artists do not know the limitations of the
technology and they design to make the
game look pretty.
Result:
something pretty to look at but no
gameplay.
Challenges
Artists vs Programmers
Programmers on the other hand know the
limitations too well and they design based
on the technology.
Result:
something works but boring and ugly.
Challenges
Artists vs Programmers
Challenges
Artists vs Programmers
Challenges
Artists vs Programmers
Think Like a Game Designer!
Challenges
Think Like a Game Designer
• Study and understand your technical constraints
• Focus on what is the core gameplay and what is the fun
• Gameplay before graphics
• Do not over-do the graphics
• Use the most economical way possible to achieve
“harmony”
AR Game Studio v. 1
Challenges
CONSTRAINTS
Hardware:
Gizmondo
Software:
No game engine needed to code in
the low level
(C/C++)
Game Design
Joe Warpin
An AR First Person Shooter (FPS)
YES! FPS!!!
What?! Another FPS????!!!!
THE BIG PROBLEM
they are all “the same”
Wolfenstein 3D
1992
Call of Duty: Black Ops
2010
THE BIGGER PROBLEM
they just sit there...
THE REALLY BIG PROBLEM
Reinventing FPS
Joe Warpin
Andrew Orlando, Daniel Hunnicutt, Matt Canei, Timothy White
Zombie AR
Blair MacIntyre, Kelli Baskett, Kimberly Spreen,
Richard Summers, Tony Tseng
ARhrrrr
Blair MacIntyre, David Cochard, Karthik Raveendran,
Kelli Baskett, Kimberly Spreen, Richard Summers, Tony Tseng
REPEAT THE PAST
Hundreds of People - X Years - Big Name
Publisher
DO SOMETHING DIFFERENT
7 people - 2 Months - School Project
AR Game Studio v. 2
www.argamestudio.org
NerdFerno
Richard Shemaka, Paul Tillery, Travis Harkleroad, Yan Xu, Emily Cribb, Dan
Spaventa, Johnathan Massey, Brandon Whitehead, Hyung-Min “Sam” Lee,
Michael Hewner, Burton Carter, Blair MacIntyre, Tony Tseng
NerdHerder
Vu Ha, Sam Mendenhall, Rohan Karnik, Yan Xu, Paul Tillery, Martin
Boumendil, Joshua Cohen, John Sharp, Blair MacIntyre, Tony Tseng
AR Rockem Sockem
Jeff Chastine, Jeff Willsion, Maribeth Gandy,
Blair MacIntyre, Tony Tseng, Vu Ha
Tools
Concept & Storyboard
Adobe Photoshop
http://www.adobe.com/products/photoshop.edu.html
Educational version: $249 perpetual or $19 per month
Tools
3D Modeling, UV Mapping and Animation
Autodesk Maya
http://students.autodesk.com/
Educational version: FREE for X years
Tools
3D Modeling, UV Mapping and Animation
Autodesk 3ds Max
http://students.autodesk.com/
Educational version: FREE for X years
Tools
3D Modeling, UV Mapping and Animation
Blender
http://www.blender.org/
FREE
Tools
Additional UV Mapping
Headus UVLayout
http://www.uvlayout.com/
FREE 30 Days Trial
Tools
Texturing
Adobe Photoshop
http://www.adobe.com/products/photoshop.edu.html
Educational version: $249 perpetual or $19 per month
Tools
Digital Sculpting & Texture Painting
Autodesk Mudbox
http://students.autodesk.com/
Educational version: FREE for X years
Tools
Digital Sculpting & Texture Painting
Pixologic Zbrush
http://www.pixologic.com/
Educational version: $429 perpetual
Tools
Additional Animation
Autodesk MotionBuilder
http://students.autodesk.com/
Educational version: FREE for X years
Tools
Game Engine / Editor
Unity
http://unity3d.com/
Free Full Non-Pro Version with
Unity Pro and Android trials
Tools
AR
Qualcomm Vuforia
http://www.qualcomm.com/solutions/augmented-reality
FREE
Tools
For This Tutorial…
Maya
Photoshop
UVLayout
Unity
Vuforia
Tutorial
Let’s get started!
Tutorial
Introduce the Qualcomm Vuforia website
Register a new user account
Tutorial
Target Creation
Tutorial
3D Modeling
Tutorial
UV Mapping
Tutorial
Texturing
Tutorial
Rigging
Tutorial
Animation
Tutorial
Download and install the Qualcomm
Vuforia plug-in for Unity
Tutorial
Import content to Unity
Tutorial
Load your first 3D model and animation
on the physical target
Tutorial
AR topic (please fill in)
Tutorial
AR topic (please fill in)
Wrapping Up
AR will play an important part
in the future of gaming
marketing games
Nestle Chocapic; Mattel Rockem Sockem
handheld games
PSP Invizimals, 3DS AR Games
console games
EyePet; The Eye of Judgement
mobile phone games
Arhrrrr; NerdHerder
This is just the beginning
There are many
other possibilities…
The time to act is now!
Questions?
Jeff Chastine | Jon A Preston | Tony Tseng
jchastin@spsu.edu | jpreston@spsu.edu | ttseng@scad.edu