National institute of science & technology
BLINK DETECTION AND TRACKING OF EYES FOR EYE LOCALIZATION
BLINK DETECTION AND
TRACKING OF EYES FOR
EYE LOCALISATION
BY
LOPAMUDRA MOHAPATRA
(200199200)
LOPAMUDRA
CS200199200
1
National institute of science & technology
BLINK DETECTION AND TRACKING OF EYES FOR EYE LOCALIZATION
INTRODUCTION
 What is blink detection?
 What is eye tracking?
 What is localization of eye?
LOPAMUDRA
CS200199200
2
National institute of science & technology
BLINK DETECTION AND TRACKING OF EYES FOR EYE LOCALIZATION
WHY WE GO FOR EYE LOCALIZATION
•
Face normalization
•
Eye gaze based human computer interface.
•
For reading detection.
• Security systems using the human iris for
identification.
LOPAMUDRA
CS200199200
3
National institute of science & technology
BLINK DETECTION AND TRACKING OF EYES FOR EYE LOCALIZATION
PROPOSED PROTOCOL
WHOLE METHOD
THRESHHOLDING
FRAMEDIFFERENCING
EYE LOCALIZATION
EYETRACKING
LOPAMUDRA
CS200199200
4
National institute of science & technology
BLINK DETECTION AND TRACKING OF EYES FOR EYE LOCALIZATION
THRESH HOLDING
LOPAMUDRA
CS200199200
5
National institute of science & technology
BLINK DETECTION AND TRACKING OF EYES FOR EYE LOCALIZATION
FRAME DIFFERENCING
LOPAMUDRA
CS200199200
6
National institute of science & technology
BLINK DETECTION AND TRACKING OF EYES FOR EYE LOCALIZATION
FRAME DIFFERENCING
LOPAMUDRA
CS200199200
7
National institute of science & technology
BLINK DETECTION AND TRACKING OF EYES FOR EYE LOCALIZATION
ALGORITHMS
Steps in the blink detection
(1) Obtain location of possible motion using
Frame differencing.
(2) Suitably thresh hold the motion regions and
obtain blobs using morphological operation and
connected components.
LOPAMUDRA
CS200199200
8
National institute of science & technology
BLINK DETECTION AND TRACKING OF EYES FOR EYE LOCALIZATION
ALGORITHM CONTD…...
(3) Remove unsuitable blobs that is either too big or
too small or have incorrect width to height ratios to
be considered as eyes.
(4) Repeat (1) to (3) until a suitable pair of blobs
are found and mark their positions.
(5) Compute optical flow field in the blob regions
(6)Mark dominant direction of motion of blobs.
LOPAMUDRA
CS200199200
9
National institute of science & technology
BLINK DETECTION AND TRACKING OF EYES FOR EYE LOCALIZATION
Algorithm contd…..
If the dominant motion
blobs
is downward in a pair of
their positions are noted.These would represent eye
closure during a blink. If the motion is not downward
then steps (1) to (6) are repeated.
(7) Repeat steps (1) to (6).
(8)Discard blobs that are not suited near the location
of the blobs found with downward motion.
LOPAMUDRA
CS200199200
10
National institute of science & technology
BLINK DETECTION AND TRACKING OF EYES FOR EYE LOCALIZATION
Algorithm contd
(8) Compute optical flow to ascertain if the dominant
motion is upward with two ball remaining or repeat
from step (7).
(9) If the dominant motion is upward, then classify
the frame beginning from the frame where downward
motion was detected to the frame where upward
motion was detected as blink frames. If after
downward motion no upward motion is detected upto
3 frames it is considered as no blinks. Process of
blink detection is started from newframe.
LOPAMUDRA
CS200199200
11
National institute of science & technology
BLINK DETECTION AND TRACKING OF EYES FOR EYE LOCALIZATION
(10) The bounding boxes of the blobs where blink is
deemed to have occurred is taken as eye detection.
OPTICAL FLOW METHOD:
It allows for the differentiation between
vertical eyelid movements during blinks and
movement of eyeball and horizotal head movements.
EYE TRACKING :
After the location of eyes tracking is
done by using KLT tracker.
LOPAMUDRA
CS200199200
12
National institute of science & technology
BLINK DETECTION AND TRACKING OF EYES FOR EYE LOCALIZATION
EYETRACKING
In eye tracking mainly there are 20 feature points are
taken,which gives the more accuracy.
* These feature pts are taken from the eye area and
they are tracked in different places,and
reinitialization is done.
LOPAMUDRA
CS200199200
13
National institute of science & technology
BLINK DETECTION AND TRACKING OF EYES FOR EYE LOCALIZATION
Results of eye tracking
(a) eye region initialized (b) tracked eye regions to a
movement just before blink.
LOPAMUDRA
CS200199200
14
National institute of science & technology
BLINK DETECTION AND TRACKING OF EYES FOR EYE LOCALIZATION
COMPUTATION SPEEDUP
To speed up localization we need to speed up in
- Optical Flow
- Eye tracking.
EXPERIMENTAL RESULT :
(1) Optical flow: 10 sec
(2) Tracking of eyes : 10 sec
(3) reading image from disk: 13 sec
LOPAMUDRA
CS200199200
15
National institute of science & technology
BLINK DETECTION AND TRACKING OF EYES FOR EYE LOCALIZATION
CONCLUSION
In this paper we have proposed an accurate
and fast method for locating and tracking the
eyes of a computer user situated in front of the
monitor. By computing optical flow and using
both the magnitude and direction of the flow
vectors, we can differentiate blinking from the
other motions. In this way our study completed.
LOPAMUDRA
CS200199200
16
National institute of science & technology
BLINK DETECTION AND TRACKING OF EYES FOR EYE LOCALIZATION
THANK YOU!!!
LOPAMUDRA
CS200199200
17
National institute of science & technology
BLINK DETECTION AND TRACKING OF EYES FOR EYE LOCALIZATION
LOPAMUDRA
CS200199200
18