SINGLE-LENS STEREOSCOPIC ARRANGEMENT WITH OVERLAPPING OF THE VIEWS

advertisement
SINGLE-LENS STEREOSCOPIC ARRANGEMENT
WITH OVERLAPPING OF THE VIEWS
Thierry FOURNEL, Corinne FOURNIER, Christophe VINCENT
Laboratoire Traitement du Signal et Instrumentation
UMR CNRS 5516 - Université J. Monnet
23, rue du Dr P. Michelon, 42023 Saint-Etienne cedex 2, France
E-mail : fournel@univ-st-etienne.fr
ABSTRACT
The single-camera stereoscopic arrangement proposed in this paper allows to overlap one another the left
and right views of an object field viewed from two symmetrical incidences. An affine camera records the
view transmitted through a semi-silvered mirror and the view reflected by an additional mirror. The
geometry of the Affine Reflection Transmission Arrangement is described. Its ability to measure a 3D
displacement is tested on a target pattern.
KEYWORDS
Affine lens, catadioptric stereo system, computational stereovision, single-camera stereoscopy
1. INTRODUCTION
Stereoscopic systems involving a single lens and a single sensor can be found in different
domains like Artificial Vision (Nene and Nayar, 1998 ; Mouaddib and Pegard, 1995) or Particle
Image Velocimetry (Prasad, 2000). As the camera is unmoved, catadioptric configurations are
used. By using a perspective camera the reflecting surfaces that perform projection of the scene
from a single viewpoint are planar or conic (Nayar and Baker, 1997).
Here we focus on arrangements recording stereo pairs from symmetrical incidences and using
fully-astigmatic mirrors i.e. planar mirrors.
The arrangement given in (Arroyo and Greated, 1991) (respectively in (Grant et al., 1991)) is a
single-camera version of the translation arrangement (respectively the rotational arrangement). In
the previous arrangements mirrors are located symmetrically according to the optical axis.
Therefore as the left view is reflected successively on two mirrors and recorded on the right side,
the left and right views are adjacent on the sensor. So, each view covers only half the sensor.
Y
Y
Z
O
Z
(a)
O
(b)
Figure 1. Single-camera version of:
(a) the translation arrangement, (b) the rotational arrangement
In this paper we propose a catadioptric stereo arrangement using a single lens and a single sensor
to view the object plane from two symmetrical incidences and to overlap the views one another.
If the object is motionless, a shuttering allows to separate the views in time and to work at the full
resolution. If the object is in motion, the views have to be recorded simultaneously. To separate
the views, a color coding added to a color camera can be used. Two color filters can respectively
be located in front of the mirror and the semi-silvered mirror.
2. DESCRIPTION OF THE ARRANGEMENT
An arm is mounted in front of the lens in order to reflect a second view. This arm is composed of
a planar mirror and a semi-silvered mirror. Located on the optical axis of the camera, the semisilvered mirror allows to record at once the direct view and the view reflected by the planar
mirror (Figure 2). The planar mirror is located on the axis symmetrical to the optical axis
according to the perpendicular (OZ) to the object plane. The two mirrors are oriented so that the
reflected image seems to be viewed from a virtual camera under the same angle as the real
camera that points towards the object plane. The location of the virtual camera is obtained from
the real camera by two successive symmetries. The symmetry according to the semi-silvered
mirror plane gives an image of the real camera (drawn with dashed lines on figure 2). From this
image, the symmetry according to the mirror plane gives the virtual camera.
Object coordinate
system OXYZ
Y
Z
Semi-silvered
mirror
O
Affine lens
Mirror
Virtual lens
Figure 2. Catadioptric single-camera arrangement to view according to symmetrical incidences
and to overlap the views one another on the sensor
Figure 3. The pair of the die faces 3 and 5 is viewed from the real camera
and the pair of the faces 2 and 3 is viewed from the virtual camera
Figure 3 shows the views of a die recorded with the arrangement given in figure 2. The incidence
angles are -20° and +20°.
3. GEOMETRY OF THE ARRANGEMENT
3.1 REFLECTION \ TRANSMISSION ARRANGEMENT
Let us note d1 the distance between the origin O of the object coordinate system OXYZ and the
center M1 of the semi-silvered mirror (on the optical axis), α the angle between the optical axis
and the Z axis and β the angle between the optical axis and the perpendicular of the semi-silvered
mirror.
The position of the mirror can be deduced from the three parameters d1, α, β of the catadioptric
centered system : the mirror (centered at point M2) is in the plane passing through the line of
intersection between the object plane and the semi-silvered mirror plane (centered at point M1).
The next paragraph gives a non analytical proof of it.
Y
Z
M1
d1
α
O
α
π−2β
β
axis of the
real camera
Ω
β
α
M2
I
I’
Figure 4. Adjustment point I of the arrangement
(the viewangles are identical)
In the horizontal plane containing the optical axis (Figure 4), let us note Ω the point where the
bisectors of the triangle OM1M2 intersect and I the point where the lines (OY) and (ΩM1)
intersect. The intersection point I’ between the line (ΩM1) supporting the first mirror and the line
supporting the second one is identical to the point I. Indeed, the triangle IOΩ rectangular at O
and the triangle I’M2Ω rectangular at M2 have the same hypotenuse :
π

ΩM 1 ⋅ sin  − β 
ΩO
2
 = ΩM 2 = ΩI ′
ΩI =
=
sin (β − α ) sin (β − α ) ⋅ sin (α ) sin (α )
The point I can be used to adjust with accuracy the position of the mirror.
(1)
3.2 AFFINE NATURE OF THE CAMERA
It must be noticed that the distance dV of the virtual camera from the origin O is greater than the
distance dR of the real camera. But to have an exact overlapping of the two views, the
magnifications must be the same for both the recordings. It is the reason why, working at a finite
distance, an affine lens (also called a “telecentric” lens) which acts as an orthogonal projection
device, is used.
Moreover the distance dV rises up respectively with the angle α and with the distance OI. But
the distance dV must be in the depth of field of the real camera.
Figure 5 shows the distance dV version the viewangle α, the distance d1=OM1 being fixed to dR/2
and the working distance dR to 180 mm. The distance dV must be less than the boundary value of
the back depth of field. There is a maximum distance OI (85 mm here) for which the angle α can
reach 45°.
Distance dV (mm)
360
340
320
300
OI=115mm
Boundary of the depth of field
280
OI=85mm
260
240
OI=55mm
220
200
180
0
5
10
15
20
25
30
35
40
45
Angle α (degree)
Figure 5. Distance dV of the virtual camera from the pointed origin of the object plane
version the view angle α
4. EXPERIMENT AND RESULTS
For testing the Affine Reflection Transmission Arrangement (ARTA), a texture was shifted of
2.50 mm according to the Z axis with a translation table (10 µm accuracy) and the displacement
field measured.
The field was imaged with an affine lens of which the working distance is 230 mm. The aperture
number was equal to 22 and the back depth of field to 70 mm (respectively the front depth of
field to 60 mm). The center O of the object plane was 180 mm far from the camera. The size of
the camera field was about 54 mm in width and 40 mm in height. The conversion factor at the
recording was about 14.3 pixel/mm according to the v horizontal and u vertical axis. The viewing
angle α was about 20° (see figure 4).
Recordings were done by masking alternatively the reflected and the transmitted views.
The semi-silvered mirror used (50 mm in width) was located on the optical axis at d1=90 mm and
did not cover the whole field. Measurements of displacement were carried out in the center of the
camera field (17 mm in width x 22 mm in height) where a linear calibration was done (Fournel et
al., 2000). The mean deviation of the calibration points projected with the calibration matrix is
about 0.15 pixel for the real camera, respectively 0.70 for the virtual camera.
Each camera gives a displacement field for which measurements are done locally by subpixel
correlation on 32x32 pixel cells. Mean values are given on table 1. The real camera gives a
standard deviation according to the displacement projection (v direction) lower than that obtained
with the virtual camera.
v
v
u
u
Figure 6. Projections of the Z displacement (2.5mm) measured
on the virtual camera (left) and on the real camera (right)
Displacement projection
Virtual camera
Real camera
u mean component
-0.56
0.24
v mean component
12.99
-13.01
u standard deviation
0.80
0.85
Table 1. Mean values and standard deviations (pixel)
of the u (up to down) and v (left to right)
measured components of the displacement projections
40
35
30
25
20
X
15
X
10
Z
5
Y
0
0
10
Y
20
-10
-5
0
5
10
Z
Figure 7. The 3D displacement measured by ARTA
v standard deviation
0.54
0.07
Displacement
Mean value
Standard deviation
X component
0.01
0.04
Y component
0.01
0.02
Z component
2.50
0.05
Table 2. Mean values and standard deviations (mm) of the components of the 3D displacement
The 3D displacement field is obtained from the two last fields and from the calibration matrix.
Mean values are given on table 2. The mean displacement is very close to the actual
displacement. The highest standard deviation (50 µm) is logically relative to the Z axis.
5. CONCLUSION
The Affine Reflection Transmission Arrangement involves a single affine camera and allows the
whole overlapping of stereo views thanks to a pair of mirrors. It has a very simple design welladapted to differential measurements. The measurements obtained with standard equipment give
an accuracy of about 0.1 mm for a 2.5 mm displacement in depth. In perspective the quality of
the image obtained by reflection has to be improved and the image coding \ decoding has to be
worked.
REFERENCES
Arroyo MP, Greated CA (1991). Stereoscopic particle image velocimetry. Meas. Sci. Technol., 2:1181-86.
Grant I, Zhao Y, Tan Y, Stewart JN (1991). Three component flow mapping : experiences in stereoscopic PIV and
holography velocimetry. ASME Proc., 1:365-71.
Fournel T, Coudert S, Riou L (2000). Stereoscopic 2D3C DPIV with telecentric lenses : calibration and first results.
Euromech 411 Proc.
Mouaddib E, Pegard C (1995). Localization using omnidirectional vision. Proc. of the 7th Int. Conf. on Advanced
Robotics, 1:133-38.
Nayar S, Baker S (1997). Catadioptric image formation. Proc. of the DARPA Image Understanding Workshop,
1431-37.
Nene S, Nayar S (1998). Stereo with mirrors. Proc. of the 6th Int. Conf. on Computer Vision, 1087-94.
Prasad AK (2000). Stereoscopic particle image velocimetry. Exp. in fluids, 29:103-16.
Download