VSS05 - CIM - McGill University

advertisement
Elongations near intensity maxima: a cue for shading?
Michael Langer
Daria Gipsman
School of Computer Science,
McGill University,
Montreal, Canada
1. Linear vs. quadratic shading
2. Shading elongations
The standard Lambertian shading model says that the intensity
of reflected light varies with the cosine of the angle between
the light source and the surface normal.
I ( x , y )  L  N ( x, y )
 
The light vector and surface normal can be written respectively
as:

L  ( Lx , Ly , Lz )

N ( x, y ) 
(
Z Z
,
,1)
x y
2
where Z(x,y) is the surface depth map.
2
 Z   Z 
      1
 x   y 
Intensity can be approximated as the sum of a linear and a
quadratic component (Pentland 1989)
 1   z 2  z 2  
z
z
I ( x , y )  Lx  Ly
 Lz  1         
 2   x   y   
x
y



linear
quadratic
Linear shading produces intensity elongations in the direction
perpendicular to (Lx, Ly). These elongations seem to play a
role in perception of illumination direction. (Pentland 1982)
Quadratic shading also produces intensity elongations. These
elongations occur at maxima of the quadratic component of the
intensity, namely at points where the surface normal is (0,0,-1).
To see why, without loss of generality, suppose (x,y) = (0,0) is a
point whose normal is (0,0,-1). In a small neighborhood of this
point, we can approximate the depth map as:
Z ( x, y )  a x 2  b y 2
The quadratic component of the image intensity near this point
obeys:
I ( x, y)  1  2 (a 2 x 2  b 2 y 2 )
3. Sparse codes and Gabor filtered shading
It is believed that oriented structures in images (such as from
occluding edges) produce “sparse codes”, in that the response
histograms of Gabor filtered images have longer tails than a
Gaussian. Do elongated intensities that arise from linear and
quadratic shading produce such “sparse codes” ?
We checked whether the Gabor response histograms (i.e.
probabilities) are better fit with a Gaussian distribution (not
sparse) or a two sided Laplacian distribution (sparse), namely,
whether the log histograms of responses are better fit by a
parabola or by a pair of lines.
Gaussian

log e
Laplacian
response2
2 2
 response
2
2
2
log e
|
response

|
  | response
|

Linear shading does not yield a sparse code
If | a | and | b | are not equal, then the aspect ratio of the
intensities is exaggerated, relative to the aspect ratio of the
depth.
The result: Intensities are elongated near intensity maxima.
Quadratic shading does yield a sparse code
depth map
Z(x,y)
I(x,y)
linear only
quadratic only
Conjecture: the quadratic component of shading
may play a role in distinguishing shading vs. nonshading.
Download