Light-field 3DTV Research
Péter Tamás Kovács
Holografika
Trends and Vision
• Next generation displays will be 3D
• Black&White  Colour  High Definition TV
• A paradigm shift in visualization
• The market is waiting for a real solution
• 3D data is already there, but lost while displaying
3D Display Technologies
Background
• 3D images contain more information than 2D
• Stereoscopic: 2x (L+R)
• Multiview: ~8-16x
• Volumetric: 20-200 slices
• True 3D: continous (~100x)
• Total number of beams law, points/sec rate
• Determine the quality of any 3D solution
• Direction selective light emission
• Common for all 3D systems having a screen
Fundamentals
• Additional independent variant
to X, Y : Φ
• Emission range: FOV
• Number of independent beams in
the range: Angular resolution
Φ = FOV / n
• Angular resolution determines FOD
Fundamentals
• Vertical / horizontal parallax
• Reduce the number of beams by
omitting vertical parallax
• Different horizontal and vertical
angular resolution
The HoloVizio System
• Optical modules
• Project light beams to the points of
the screen from various angles
• Holographic screen
• Direction selective property with
angularly dependent diffusion
characteristics
• Emission angle geometry
determined
• The screen performs the necessary
optical transformation, but makes no
principal change in directions
• No optical road-blocks like at parallax
barrier, lenticular lenses
The HoloVizio System
• Specific distributed image
organization
• A module is not associated to
a direction
• Each view of the 3D image
comes from multiple modules
• Smooth and continous
transition between views
• Light field reconstruction
instead of views
The HoloVizio System
• HoloVizio image synthesis
• Spatially addressable light-rays
• 2D + Angular resolution
• Horizontal (vertical) parallax
• Scalability
• High pixel count
• Any aspect ratio
• From small to large scale
systems
• Price / Performance
• Possible to build perfect 3D
displays
HoloVizio Displays
• HoloVizio Monitors
• 7-10 Mpixel
• Single PC
• 1-4 DVI inputs for 25 FPS
• Large-scale HoloVizio
System
• Rendering cluster of 16 PCs
• Gigabit Ethernet
• Digital signage HoloVizio
system
• Rendering cluster of 3 PCs
• Gigabit Ethernet
HoloVizio Displays
• The world first glasses-free
3D cinema system:
• HoloVizio C80
• 3,5 m dia Holoscreen (140”)
• No glasses, no optical
contradiction
• LED based 3D projection unit
• Exceptional 1500 Cd/m2
brightness
• 40 degrees FOV
• 2D compatible
• Fitting cinema rooms, 3D
simulators
HoloVizio SW System
• Integrate existing applications / display 3D models
in real-time
• Interactive applications
• Display pre-rendered
3D models
• High quality images
• Display real-life 3D
scenes
• Light field streaming
Integrate Existing Apps
• OpenGL wrapper for HoloVizio display systems
User computer
Legacy
OpenGL Application
OpenGL Wrapper
OpenGL
Display driver
2D display
HoloVizio
Display Pre-Rendered 3D
Favourite Renderer
HoloVizio scripts
3D display
HoloVizio
Converter
HoloPlayer
Live 3D transmission
• Linear camera array
• 27 cameras
• 640x480 at 15 FPS
• 960x720 at 10 FPS
• Camera calibration
• Mapping of camera pixels
to light rays
• Transmission
• Video streams
• 100 Mbit now, 30 Mbit with
H.264
• Display
• Any HoloVizio display
COHERENT project
• To create a networked
holographic platform to
support multi-user realtime collaborative 3D
interaction between
geographically distributed
teams.
• To create two innovative
applications:
• a collaborative medical
visualisation system
• a collaborative design
review system for the
automotive industry
 Large-scale HoloVizio
Internet
Intranet
HOLOVISION project
• To realize a >100x capacity jump
of current displays
• real technology challenge
• to build a no-compromise display
• a milestone towards Gigapixel
displays
• To realize a novel principle
• combination of spatial and time
multiplexing
• to fully exploit component
capabilities
• To use latest available
technologies and components
• Hi-res microdisplays, LEDs
 World’s first 100 MPixel 3D
display
OSIRIS project
• Glasses-free 3D cinema prototype
• 2nd generation desktop monitor
• Real-time Light-field capture
MUSCADE project
• The MUSCADE project defines,
2D Display
Stereoscopic
display + binoculars
3D Professional
Camera
Satellite
Computer
Generated
PostProduction
Wireline
Internet
ADSL, ADSL2+,
VDSL
3D
Player
develops, validates and evaluates the
technological innovations in 3DTV
capturing, data representation,
compression, transmission, rendering
and display adaptations required for a
technically efficient and commercially
successful 3DTV broadcast system.
Satellite
WiMAX, WLAN, DVB-T(2)
Autostereoscopic
display
(Tracked stereo)
Multiview display
Wireless
3D Video
Programs
Broadcaster
Lightfield display
Remote
control
User interactivity
Residential
consumer
DIOMEDES project
• DIOMEDES focuses on new
methods for the compression
and delivery of multi-view
video and multi-channel
audio to users.
• The DIOMEDES approach is
to develop a 3D Peer-to-Peer
(P2P) distribution system,
which will be designed jointly
with novel video compression
techniques. The compression,
distribution, and security
technologies developed within
DIOMEDES will be
demonstrated in the form of
an integrated test bed.
3D Content Server
Broadcast
Tx
Broadcast
Rx
Peer
3D Media
IPTV
Streaming
Server
Master Peer
Broadcast
Rx
Peer
Broadcast
Rx
Peer
3D VIVANT project
• The 3D VIVANT project investigates the possibility of using different
technologies for capture and display of 3D content
• For capture, 3D VIVANT takes full advantage of 3D Holoscopic
imaging technology, where a single camera is required
• For the display, the project takes advantage of the hologram
geometrical principles to provide immersive, ultra high resolution
presentation of 3D content
Thank You!
www.holografika.com
EU IST-FP7 Integrated Project MUSCADE
http://www.muscade.eu/