Uploaded by sivan

demarcation line

advertisement
2018 International CET Conference on Control, Communication, and Computing (IC4) | July 05 – 07, 2018 | Trivandrum
Computer Aided Detection of Demarcation line/
Ridges in the Retinal Fundus Images of Preterm
Infants
Gokul G kurup
Kavya J S
Sivakumar R
Department of ECE
College of Engineering Trivandrum
Trivandrum, India
gokulgkurup15@gmail.com
Department of ECE
College of Engineering Trivandrum
Trivandrum, India
kavyajs1992@yahoo.in
Department of ECE
College of Engineering Trivandrum
Trivandrum, India
sivan@cet.ac.in
Abstract—Retinopathy of Prematurity (ROP) is a curable sight
threatening disease which affects the visual system of premature
infants, weighing less than 1750 grams and who are born before
31 weeks of gestation. The characteristic features of the disease
include abnormal blood vessel growth and scar tissue formation
in the retina which may lead to permanent blindness. The risk
of ROP can be reduced if the disease is diagnosed in the early
stage of its development. As per the recommendations of the
International Committee for ROP classification, the detection
of demarcation line/ridge have great prognostic significance as
its presence indicates the beginning stage of the disease. In
the reported work we develop a computer aided diagnostic
system for the early detection of ROP, where the presence of
ridge/demarcation line is identified in the fundus images of the
preterm infants. The developed system uses image enhancement
techniques followed by clustering operation. An image database
with 33 retinal images of preterm infants are graded with the
proposed system and the results obtained matches with that of
the clinical expert annotation with a good accuracy.
Index Terms—Retinopathy of prematurity, demarcation line,
clustering
impairment and childhood blindness. The International Committee for ROP classification [2] categorize the disease into
five stages where the presence of demarcation line is noticed
in first stage followed by ridge formation in the succeeding
stage. Fig.1 shows the retinal images of the five different stages
of ROP. In the initial stage, a faint demarcation line appears
between the vascular and avascular retinal zones and this line
progresses into a structured intra-retinal ridge in the second
stage. The ridge then extends above the plane of retina leading
further to retinal detachment and permanent vision loss.
(c)
(b)
(a)
I. I NTRODUCTION
Computer vision techniques are gaining importance in the
medical research for the fact that there exists the need for
handling a large amount of image data acquired from various
imaging devices. The range of the acquired data include
images obtained from diagnostic machines to microscopic cell
or tissue images. In the developing countries like India the
disease screening programs organised especially in rural areas
create large amount of image data sets for initial screening.
The current screening procedure involves an expert clinician
manually grade these images and make diagnostic decisions.
Literature shows that there exists wide inter-expert variability
in opinion among the experts [1] and the procedure is time
consuming as well as not economical. So there arises the
need for an automated computer aided diagnostic system for
the automated screening of the diseases. In the reported work
retinal image of preterm infants for the automatic detection of
ROP ridges/demarcation line is discussed.
Retinopathy of Prematurity (ROP) is a proliferative retinal
vascular disease which is the leading cause of lifelong vision
978-1-5386-4966-4/18/$31.00 ©2018 IEEE
(d)
(e)
Fig. 1. Stages of Retinopathy of prematurity, (a) Stage I, (b) Stage II, (c)
Stage III, (d) Stage IV and (e) Stage V [5]
ROP has no external signs or symptoms. The only way to
detect its presence is through the analysis of retinal images by
an expert clinician. The literature provides substantial amount
of researches for the automated disease diagnosis [3], [4], [5],
[6]. In all the reported works blood vessel properties like
tortuosity, width, arcade angle etc. are used for the disease
evaluation. But these properties are not always present or
notable in the initial stage images of the disease. So the
detection of demarcation line or ridges plays a major role in
early diagnosis and further treatment of the disease.
A great deal of literature provides information about the
image processing techniques used to detect the ridges. But
in retinal images the contrast values of the ridges and the
171
2018 International CET Conference on Control, Communication, and Computing (IC4) | July 05 – 07, 2018 | Trivandrum
Input image
pre-processing
(a)
clustering
contrast
enhancement
(b)
(c)
line/ridge detection
(f)
cluster selection
(e)
(d)
Fig. 2. Schematic of the proposed method which consists of four main steps: (a) Pre-processing, (b) image enhancement, (c) clustering, and (d) line/ridge
detection.
background are almost same which make its detection very
challenging. It is worth to note that related works on ROP
diagnosis based on line/ridge detection is very less. The first
work in this area is the one proposed by Sinthanayothin et
al. [7] where an early stopping watershed algorithm is used
for the detection purpose. In this work preprocessing and
image enhancement plays a major role for emphasizing the
ridges from the background. In the work proposed by Prabakar
et al. [8], a two-dimensional isotropic undecimated wavelet
transform (IUWT) is used for ridge detection. To the best of
our knowledge these are the only two significant works on
ROP detection based on line/ridges.
In this reported work we combined the image pre-processing
results with contrast enhancement and clustering operations.
Once the line/ridges are differentiated we segmented them with
a good accuracy.
II. M ATERIALS AND METHODS
A. Data set used
We use a set of 33 retinal images that we obtained
from Karnataka Internet Assisted Diagnosis of Retinopathy
of Prematurity, (KIDROP) Bangalore, India. The images are
TM
captured with a RetCam3
camera with a field of view of
130 degrees and a resolution of 1600 × 1200 pixels. Of the 33
images, eight contain signs of line/ridge while the remaining
are marked as normal. The images were labelled by a group
of medical experts and a consensus was reached among their
opinions before final labelling.
B. System methodology
The proposed method consists of four main steps namely
pre-processing, image enhancement, segmentation based on
clustering and finally line/ridge detection. Below we elaborate
on each of these steps in detail. Fig.2 shows the schematic of
the proposed work.
1) Pre-processing: The selection of a suitable color space
is very important in this study as line/ridge is not emphasized
equally in different color spaces. Since there is no prior
knowledge about in which color space the line/ridges are
clearly distinguishable, in the preprocessing stage we convert
the input RGB images to different color spaces namely HSV,
YCbCr, HSI, CMY and YIQ. After carefully analysing the
transformed images, it is found that images with demarcation
line/ ridges are much pronounced in the intensity channel I
of HSI (hue, saturation, intensity) colour space. The RGB and
HSI color spaces are mathematically related as:
(
θ
if
B≤G
H=
(1)
360 − θ if
B>G
where
172
(
θ = cos−1
[(R
S =1−
1
2 (R − G) + (R − B)
1
− G)2 + (R − B)(G − B)] 2
3
[min(R, G, B)]
(R + G + B)
I=
1
(R + G + B)
3
)
(2)
(3)
(4)
2018 International CET Conference on Control, Communication, and Computing (IC4) | July 05 – 07, 2018 | Trivandrum
So further analysis are carried out in the intensity channel
derived from HSI color space.
2) Image enhancement: The contrast of preprocessed images are enhanced by different spatial and frequency domain
techniques. While performing the image enhancement the
contrast of retinal blood vessels also gets lifted up along
with the demarcation lines/ridges. Hence the segmentation task
becomes very difficult. We used the combined effect of both
spatial and frequency domain techniques to achieve our desired
objective.
The contrast of the extracted intensity channel image is
enhanced by using morphological top-hat transform [9] which
is a spatial domain technique. The transformation is obtained
by taking the difference between the input image and its
morphological opening by a disc structuring element of radius
12 pixels. Top- hat transformation helps to remove the uneven
background illumination from the image and is mathematically
represented as:
T (I) = I − (I ◦ b)
(5)
where T (I) is the top-hat transformed output of image I, b
is the structuring element and ◦ denotes the morphological
opening operation. Then we apply frequency domain enhancement technique based on Gaussian high pass filtering on the
tophat transformed image. For this the transformed image in
spatial domain is converted into frequency domain and filtered
with a Gaussian high pass filter. The filtered output is transformed back to spatial domain by using inverse discrete 2DFourier transform. Further, the reconstructed image in spatial
domain is enhanced using contrast limited adaptive histogram
enhancement (CLAHE) [10] to obtain a high contrast image
where ridges are highly emphasized.
In order to avoid the false positive detection at the boundary
of the image due to the undesired border effects, masking
is done by using synthetic masks obtained by thresholding
operation.
3) Image clustering: Clustering basically means grouping
similar objects together. k-means clustering [11] is an exploratory data analysis technique which uses a non hierarchical
method of grouping objects together. It classifies n data points
into k clusters by using some minimum distance metric. The
flowchart indicating the k-means clustering operation is shown
in Fig. 3
4) Demarcation line/ridge detection: The clusters obtained
from k-means clustering operation are analysed for the presence of demarcation line/ridges. The great challenge we faced
in this work is the differentiation of ridges from the other
fundus features like the optic disc region, retinal blood vessels
and the boundary pixels. By analysing the clusters we found
that a cluster with the maximum mean has the highest chance
of finding the presence of ridge. Therefore the cluster with
the maximum mean is automatically selected for the further
analysis.
If ridge/line is present we proceed with the further steps
of ridge detection. We extracted the ridges by eroding the
Fig. 3. Flowchart showing the sequence of operations performed during kmeans clustering operation
image by a structuring element and finding the connected
components. Finally the unwanted noises are removed from
the image and color coding is done (red marks the presence
of line/ridge) for better understanding.
III. R ESULTS AND DISCUSSION
Eventhough literature contains a fairly good amount of ROP
related research, works related to the detection of demarcation line/ridge for its diagnosis is very less. The prognostic
significance of demarcation line/ridge indicates the need of
an extensive research in this field for early diagnosis. The
incidence of ROP in India is reported to vary between 3851.9% in low birth weight infants and greater than 80% in
infants born less than 28 weeks of pregnancy [12]. So any
measures which aids the early detection of ROP can reduce
the childhood blindness rate to a great extend.
For the validation of our work we used the images obtained
from KIDROP, Bangalore, India. Since the images are of size
1600 × 1200 pixels, before preprocessing images are resized
using bicubic interpolation where the output pixel value is the
weighted average of pixels in the nearest 4×4 neighbourhood.
The resizing of image reduces the execution time of the
whole process. In the reported work before arriving into the
system methodology like we explained in the previous section,
we used several conventional image processing techniques
to segment out the ridges from the images. But due to the
eqi-contrast ridges and the background, we didnt get any
fruitful results. So we start with verifying ridge contrast in
various color spaces and found that intensity channel of HSI
color space gives optimum results. After selecting this color
channel for further processing contrast enhancement is done
by combining spatial and frequency domain techniques.
Contrast enhanced images are then subjected to clustering
operation by using k-means clustering technique. In this work
the value of k is selected as three, which represents the number
of clusters. In order to differentiate the normal images from
173
2018 International CET Conference on Control, Communication, and Computing (IC4) | July 05 – 07, 2018 | Trivandrum
Fig. 4. Image N5 of KIDROP database with line/ridges (a) Input image (b) pre-processed image (c) contrast enhanced image (d)-(f) clustered images using
k means clustering (k=3) (g) detected ridges/line embedded in the original image(a)
Fig. 5. Image N23 of KIDROP database without line/ridges (a) Input image (b) pre-processed image (c) contrast enhanced image (d)-(f) clustered images
using k means clustering (k=3) (g) detected ridges/line embedded in the original image(a)
that with line/ridge contained images, a threshold is set for the
cluster mean. Here we set the value as 0.13 and if the mean of
any cluster is greater than this value, the condition of presence
of ridge is satisfied and if it is less that image is marked as
normal. In our work this threshold selection is the only place
which requires some manual intervention.
To evaluate the performance of the proposed system, we
compute the specificity (Sp) and sensitivity (Se) measures,
which are expressed as:
Sp =
TN
T N +F P
and Se =
TP
T P +F N
were TP, FP, FN and TN represent true positives, false positives, false negatives and true negatives, respectively. Out of
the 33 images (eight with demarcation line/ ridges and the
remaining normal), our system classified 31 images correctly.
All images with ridges are correctly identified and the misclassified two images belong to the healthy class. Hence, TP = 8,
FP = 2, FN = 0 and TN = 23. This means that we achieve a
sensitivity of 1.0 (we detect eight ridge cases) and a specificity
of 0.92. For the true positive case there are some missing
ridge regions seen on the output images, and are under the
acceptable mark. The output obtained for the input image N05
(Fig. 4) and N23 (Fig. 5) of KIDROP data set are shown.
IV. C ONCLUSION
In the proposed work we present a very simple approach
for diagnosing the early stage ROP by detecting line/ridge in
the retinal images of preterm infants. The main hindrance to
the research is the non availability of standard datasets for
testing and validation of developing algorithms. Eventhough
our system claims a high sensitivity, there is a great room
for further improvement. Future works include testing the
algorithm in a large datasets for validation. More advanced
computer vision algorithms can be applied for improving the
results. Since ROP diagnosis by using line/ridge detection is
in its beginning stage, our work is having its own relevance
174
2018 International CET Conference on Control, Communication, and Computing (IC4) | July 05 – 07, 2018 | Trivandrum
in the medical field.
ACKNOWLEDGEMENTS
We thank Dr. Anand Vinekar, KIDROP Bangalore for
sharing his valuable thoughts in the clinical side of ROP and
also for providing the real images and its annotations.
R EFERENCES
[1] Gschließer, Andreas and Stifter, Eva and Neumayer, Thomas and Moser,
Elisabeth and Papp, Andrea and Pircher, Niklas and Dorner, Guido and
Egger, Stefan and Vukojevic, Nenad and Oberacher-Velten, Isabel and
others, Inter-expert and intra-expert agreement on the diagnosis and
treatment of retinopathy of prematurity detection and pattern recognition,
American journal of ophthalmology, 160(3), 553-560, 2015.
[2] American Medical Association, ”The International Classification of
Retinopathy of Prematurity Revisited, ARCH OPHTHALMOL, volume
123. July 2005.
[3] Koreen, Susan and Gelman, Rony and Martinez-Perez, M Elena and
Jiang, Lei and Berrocal, Audina M and Hess, Ditte J and Flynn, John T
and Chiang, Michael F, Evaluation of a computer-based system for plus
disease diagnosis in retinopathy of prematurity, Ophthalmology, 114(12),
59-67, 2007.
[4] Sivakumar, R and Eldho, Manu and Jiji, CV and Vinekar, Anand and
John, Renu, Computer aided screening of retinopathy of prematurityA
multiscale Gabor filter approach, Embedded Computing and System
Design (ISED), 2016 Sixth International Symposium on, 259–264, 2016.
[5] Wallace, David K and Jomier, Julien and Aylward, Steven R and Landers, Maurice B, Computer-automated quantification of plus disease in
retinopathy of prematurity, Journal of American Association for Pediatric
Ophthalmology and Strabismus, 7(2), 126-130, 2003.
[6] F.Oloumi, R.M.Rangayyan, Assessment of vessel tortuosity in retinal
images of preterm infants,36th Annual International Conference of the
IEEE Engineering in Medicine and Biology Society,54105413, 2014.
[7] Chanjira Sinthanayothin, Sarah Barman, ”An Automatic Detection of
the Retinopathy of Prematurity Demarcation- line/Ridgeon Infant Retinal
Images, IEEE Region 10 Annual International Conference, Proceedings/
TENCON, A151-A154, 2004
[8] Prabakar, S and Porkumaran, K and Shah, Parag K and Narendran
”Implementation of stochastic approach for vessel and ridge studies
in retinopathy of prematurity screening,CURRENT SCIENCE, V,Volume
112, Issue 3, March 2017, pp.517
[9] Md. Bai, Xiangzhi and Zhou, Fugen and Xue, Bindang, ”Image enhancement using multi scale image features extracted by top-hat transform,Optics & Laser Technology , pp. 328-36, 2012
[10] Md. Foisal Hossain, Mohammad Reza Alsharif, ”Image Enhancement
Based on Logarithmic Transform Coefficient and Adaptive Histogram
Equalization, International Conference on Convergence Information Technology , pp. 14391444, 2007
[11] Hartigan, John A and Wong, Manchek A, ”Algorithm AS 136: A kmeans clustering algorithm, Journal of the Royal Statistical Society. Series
C (Applied Statistics), 28(1) ,pp. 100-108 1979.
[12] Dogra, Mangat R and Katoch, Deeksha, Current Perspectives in the
Management of Retinopathy of Prematurity, The Official Scientific Journal of Delhi Ophthalmological Society,25(2), 108-117, 2015.
175
Download