I.H.L.A MEDIA
Christopher Fuller, Nicholas Johns,
Ashley Kaufman, Brandon
McCauley, Matthew Pachol,
Christopher Suever
PROBLEM STATEMENT
 Wish to examine what it takes to create a seamless
experience between an individual and technology
 Through the use of interactive “mirrors”, our objective is to
get the observer to interact with a pre -designed interface and
allow them to have control over the outcome that would
create a memorable experience
 Applications for our proposed design would be through it’s use
in advertising and entertainment purposes.
PROBLEM BACKGROUND
 It is predicted that spending on digital ads will surpass the
combined total of ad spending on newspapers and magazines
ads in 2015
 One of the biggest problems with digital advertising is a large
varying demographic of customers
 Form of art that involves the spectator in a way that allows
the art to achieve its purpose
 Immersive Environment: Real -time image processing and
manipulation, biometric feedback and be aesthetically
pleasing.
MAJOR TECHNOLOGIES
 Raspberry Pi
 Single board computer
 CPU, GPU, USB AND HDMI
 Raspberry Pi camera module
 5 mega-pixel for images
 1080p, 30 frames/sec for video
 HD monitors
 LCD/LED monitors
 720p or higher resolution
 HDMI compatible
HARDWARE SPECIFICATIONS
Micro-USB Power Port: 700mA
(3.5W)
HDMI 2.0: Up to 18 Gbits/s
USB 2.0: Up to 480 Mbits/s
Ethernet RJ45:10/100Mbits/s
High Bit Rate SD Cards: 95 MB/s
Raspberry Pi Camera: 1080p
Monitor Display: At least 720p
ARCHITECTURE OF SYSTEM
LEVEL 0
Module
Raspberry Pi: Model B, Raspbian OS
Inputs
Raspberry Pi Camera: 5 MP (images), 1080p (video), 15-pin ribbon connection , >
15 Mbits/s
Micro USB Power Port: 700 mA, 3.5 W, 5V DC
Outputs
HDMI Video Output: 1080p, 30 fps, Up to 15 Gbits/s
Functionality Acquire and manipulate the camera input to produce HD video output.
LEVEL 1
Module
Camera Serial Interface
Raspberry Pi Camera: 5 MP (images), 1080p (video), 15-pin ribbon connection, > 15 Mbits/s
Inputs
Power: > 250 mA
Outputs
Functionality
RPi Camera Image: 5 MP resolution
Serves as the connection port between the Raspberry Pi and the Raspberry Pi camera to
enable image acquisition.
LEVEL 1
Module
System on a Chip (SOC): Broadcom BCM2835, (CPU, GPU, DSP, SDRAM, USB port)
RPi Camera Image: 5 MP resolution
Inputs
Power: 700 mA
Outputs
Functionality
Manipulated RPi Camera Image: 5 MP resolution
Integrates all components of the RPi module into a single chip. Serves as the medium between
image acquisition and video output to manipulate the RPi camera image.
Module
High-Definition Multimedia Interface
Inputs
Manipulated RPi Camera Image: 5 MP resolution
Power: 700 mA
Outputs
Video Output: 1080p, 30 fps, up to 15Gbits/s
Functionality
Interface for transferring the manipulated RPi camera image data from
the HDMI-capable RPi camera to a compatible computer monitor in order
to display the HD video output.
LEVEL 2
LEVEL 2
Module
Central Processing Unit: 700 MHz, ARM1176JZF-S core
RPi Camera Image: 5 MP resolution
Inputs
Outputs
Functionality
Module
Power: 700 mA
Manipulated RPi Camera Image: 5 MP resolution
Responsible for the pre-processing (resizing) of the acquired image data as well as
performing image edge detection and contour finding.
Graphics Processing Unit: Broadcom VideoCore IV @ 250 MHz, OpenGL ES 2.0 (24 GFLOPS),
1080p30 h.264 high-profile decoder and encoder
RPi Camera Image: 5 MP resolution
Inputs
Outputs
Functionality
Power: 700 mA
Manipulated RPi Camera Image: 5 MP resolution
Provides openGL ES 2.0, hardware accelerated openVG, and 1080p30 h.264 high profile decoder
and encoder. This controls the image data manipulation by use of algorithms including Shaders,
Particles, and Grey-Scott Reaction Diffusion.
OPENFRAMEWORKS
 High-level open source toolkit
 C++, object oriented
 Allows for direct calls to native system libraries
 MIT licensed: freedom of use in commercial or non commercial applications.
 Cross platform C++ interface to graphics, audio, video,
networking and access to many libraries
STRUCTURE OF OPENFRAMEWORKS
 Header file
 Blue print or empty structure with no implementation detail
 Cpp file
 Definition of functions and program.
 Setup()
 Allows for setting of program specifics prior to running the program
(setting the windows size, frame rate, etc.)
 Update()
 Use for continuously updating the state of the program
 Draw()
 Allows for the interaction of the system.
OUTCOMES
Particle System
Gray Scott Diagram
REACTION DIFFUSION EXAMPLE
CONTEXT DIAGRAMS
USE CASES
Standby
Image
Acquisition
Image
Processing
User
Image
Meshing
Output
User
SEQUENCE DIAGRAMS
Standby
Image Acquisition
User
System
Camera Allocation
Digital Image
Success
ImageAcquisition()
SEQUENCE DIAGRAMS
Image Processing
User
System
Image Meshing
User
Output
System
System
User
Output to user
Digital Image
Image Values
ImageProcessing()
Image Values
Success
Applied Mesh
Success
Output()
ImageMeshing()
Success
Return to Image Acquisition
OBJECTIVE TREE
EXPECTED OUTCOMES
Task
Description
Members
Hardware Integration
Make sure hardware applications are compatible as well as
work as a cohesive unit
Fuller, Johns, Kaufman, McCauley, Pachol, Suever
Software Integration
Making sure the programming languages and image
modification algorithms are compatible.
Fuller, Johns, Kaufman, McCauley, Pachol, Suever
Algorithm Design
Create software algorithms to modify a user’s image in
various ways.
Fuller, Johns, Kaufman, McCauley, Pachol, Suever
Algorithm Implementation
Test to determine whether the algorithms designed are
functional and work to display the output.
Fuller, Johns, Kaufman, McCauley, Pachol, Suever
Ensure that the hardware as well as software is compatible
and work to display the output.
Fuller, Johns, Kaufman, McCauley, Pachol, Suever
Create a working prototype that combines all prior tasks and
works properly.
Fuller, Johns, Kaufman, McCauley, Pachol, Suever
Software and Hardware
Integration
Completed Prototype of System
PROJECT PLAN
CHALLENGES AND UNCERTAINTIES
 Integrating all technologies cohesively
 Designing multiple innovative unique display options
 Creating the system to work in real -time.
 Allowing the user with a free range of interactive possibilities
 Create a system at a low cost.
 Develop the system that has minimal power concerns.
FAILURE ANALYSIS
Activity
Power Loss
Software Failure
Hardware Failure
Environmental
Issues
System overheating
Image output
Failure
Cause
System experiences an Over-heating of the system
external power loss.
as well as the over
consumption of power due
to a single component.
Code or software does Code has “bugs” or other
not function properly. failures within or the
software used is not
compatible.
Hardware does not
Over-heating of the system
work properly.
or the connections between
the components are not
ideal.
Lighting of the
Too much or too little
environment causes
lighting for the system. The
an issue within the
space in which the system is
system.
in is not large enough for
proper image retrieval.
Solutions
Allow for the system to be in an environment that
allows for proper heating of the system as well
as monitor the system’s power consumption.
System over-heats
causing a failure within
the system.
The image output
quality is not ideal or
does not work at all.
Monitor the system’s power consumption.
Power consumption of the
Raspberry Pi or other
components is too high.
The image manipulation
does not yield a output
image that is ideal.
Software, code or Raspberry
Pi does not work properly.
Determine if the code is “bug” and confirm that
the software is functioning properly.
Test connections between the components to
determine if they are connected. Also to monitor
the system’s power consumption.
Allow for the system to be placed in an
environment that is ideal for image retrieval as
well as image output. A well lit room as well as a
room that is large enough for image retrieval
that does not compromise the system.
Test the output of the system onto the monitor
and determine if it’s both in as close real time as
possible as well in the quality that is ideal.
COMPONENT PROCUREMENT PLANS
 Raspberr y Pi
 Purchased from distributor
 HD Monitors
 Utilizing monitors that we have in our possession
 Camera
 Raspberry Pi Camera module purchased from distributor
 Openframeworks
 Obtained from Openframework website
 Visual Studio
 Obtained from Dreamspark website.
CREATIVE AND INNOVATIVE ASPECTS
 Digital interactive art is a growing art form that incorporates
science and technology.
 Immersive environment consists of human -computer interface
which promotes social engagement from users.
 Complex algorithms combined with the level of interactivity
leads to memorable and unique aesthetics.
 Incorporates STEM aspects into the market world.
CONCLUSION
 Project is meant to be intuitive and aesthetically pleasing.
 Multiple uses such as advertising, art or just fun
entertainment.
 Main goal: provide a memorable, unique and interactive
experience for the user.
QUESTIONS?