1. Introduction
Computational Plenoptic Imaging
Gordon Wetzstein 1 Ivo Ihrke 2 Douglas Lanman 3 Wolfgang Heidrich 1
1 University of British Columbia 2 Saarland University 3 MIT Media Lab
I. Introduction
Eurographics 2011 – State of the Art Report
EG 2011 | Computational Plenoptic Imaging STAR | I. Introduction 1
The Mantis Shrimp
3 bands = trinocular vision with each eye!
Up to 16 different photoreceptors:
• 12 for color (4 UV, visible, IR)
• 4 for polarization (linear & circular)
EG 2011 | Computational Plenoptic Imaging STAR | I. Introduction 2
Cameras are modeled as one Human Eye webvision.med.utah.edu
How would a camera look like if it was modeled as a mantis shrimp eye?
[Williams 91] http://en.wikipedia.org/wiki/Bayer_filter
EG 2011 | Computational Plenoptic Imaging STAR | I. Introduction 3
The Plenoptic Function
• Ray-based model for light
• Includes variations in space, time, wavelength, and directions
• Light field is
P
P
t V V V x y z
)
P
P
, x y
)
V y
V x
More common angular parameterization
EG 2011 | Computational Plenoptic Imaging STAR | I. Introduction
[Adelson & Bergen 91]
4
Plenoptic Information Sampled
HVS
Consumer
Video Camera
4 Plenoptic Parameters
Sampled (no V x,y,z
)
1920x1080 (HD)
3, Bayer color filter array continuous, ~30fps
(band-limited)
1
Allan Brooks, EE421, 2003
EG 2011 | Computational Plenoptic Imaging STAR | I. Introduction 5
Computational Photography and Plenoptic Imaging
• CPI: joint optical modulation & computational processing of plenoptic dimensions
• CP: computational optics, illumination, probes, reconstruction, image processing, sensors, etc.
EG 2011 | Computational Plenoptic Imaging STAR | I. Introduction 6
Taxonomy and Overview
II.
III.
High Dynamic Range Imaging
Spectral Imaging
– 10 minutes, Wetzstein
– 10 minutes, Wetzstein
– 25 minutes, Lanman IV. Light Field Acquisition
V. Space & Focal Surfaces
VI. Temporal Multiplexing
– 15 minutes, Wetzstein
– 10 minutes, Wetzstein
VII. Further Light Properties
VIII. Discussion
EG 2011 | Computational Plenoptic Imaging STAR | I. Introduction
– 10 minutes, Wetzstein
– 5 minutes, Wetzstein
7
Next: High Dynamic Range Imaging
EG 2011 | Computational Plenoptic Imaging STAR | I. Introduction 8
