Improved Segmentation Technique to Detect Cardiac Infarction in MRI C-SENC Images Ahmad O. Algohary1, Ahmed M. El-Bialy2, Ahmed H. Kandil2 and Nael F. Osman3. Abstract — Composite Strain Encoding (C-SENC) is a new MRI technique for simultaneously acquiring cardiac functional and viability images. It combines the use of Delayed Enhancement (DE) imaging to identify the infracted (dead) tissue inside the heart muscle and the ability to image myocardial deformation from the Strain Encoding (SENC) imaging technique. In this work, a new unsupervised multistage method is proposed to objectively identify infarcted heart tissues in the functional and viability images provided by CSENC MRI. The proposed method is based on sequential application of Bayes classifier, Otsu thresholding, morphological opening, radial sweep boundary tracing and the fuzzy C-means (FCM) clustering algorithm. This method is tested on images of eleven patients with and without myocardial infarction (MI) and on simulated heart images with various levels of superimposed noise. The resulting clustered images are compared with those marked up by expert cardiologists who assisted in validating results coming from the proposed method. Infarcted myocardium is correctly identified using the proposed method with high levels of accuracy and precision. I. INTRODUCTION T HE accurate characterization of myocardial function and viability following myocardial infarction (MI) is important for therapeutical decision-making. Cardiac functional images provide useful information about the contractility patterns in the affected regions [1]. In contrast, the viability images can be used to differentiate viable and nonviable tissues [2]. By combining the functional and viability information, three different myocardial tissue types can be identified: (i) normally contracting tissue, which represents normal myocardium; (ii) non-contracting yet viable tissue, which represents “hibernating” myocardium; and (iii) nonviable tissue, which represents infarcted myocardium. Notably, the function of hibernating myocardium may improve after revascularization, whereas that of infarcted myocardium does not [3]. Previously, a method is proposed to identify different heart tissues from MRI C-SENC images using an unsupervised multi-stage fuzzy clustering technique. The method was based on sequential application of the Fuzzy Cmeans (FCM) and iterative self-organizing data (ISODATA) 1 Ahmad Algohary is working as a Biomedical Software Engineer for Diagnosoft Inc., Cairo International Office, Egypt. E-mail: ahmad.algohary@diagnosoft.com. 2 Systems and Biomedical Engineering Dept., Faculty of Engineering, Cairo University, Giza, Egypt. 3 Radiology Department, School of Medicine, Johns Hopkins University, Baltimore, North Carolina, USA. clustering algorithm [4]. In a more recent work [5], Bayesian classifier was proposed to identify the background region, then the filtered tissue regions were classified into the different tissue types using FCM algorithm. In this work, a new, unsupervised, multi-stage segmentation method is proposed to objectively characterize different heart tissues from tuned images provided by Composite Strain Encoding (C-SENC) MR Images of shortaxis planes of the heart, and thereby identify infarcted myocardial tissues. This method is based on the application of Bayesian classifier, Otsu’s thresholding technique, morphological opening, radial sweep boundary tracing and the fuzzy C-means (FCM) clustering algorithm. Numerical simulations, real MR images of patients and expert cardiologists’ markings were used to validate the segmentation technique, which showed excellent results with respect to accuracy and precision. II. THEORY A. C-SENC Recently, the Composite Strain Encoding (C-SENC) MRI technique has been introduced for simultaneous cardiac functional and viability imaging in a single short breathhold [6]. No additional time, when compared with standard Delayed Enhancement (DE) viability imaging, is required for acquiring the additional functional images. This technique results in three images: no-tuning (NT), lowtuning (LT), and high-tuning (HT). Bright regions in the NT, LT, and HT images represent infarction (or blood), akinetic, and contracting tissues, respectively. An anatomy (ANAT) image of the heart can also be constructed by adding the LT and HT images as described in [1] to show the anatomical structure of the heart (both contracting and non-contracting myocardium) with no signal from blood. Figure 1 shows an example of acquired C-SENC images. a) b) c) Fig. 1. C-SENC Images of a patient suffering myocardial infarction: a) NT, b) LT, c) HT B. Bayes Classifier Bayes classifier is based on the statistical model of classes need to be classified when their probability density functions are known [7]. In this work the Bayesian classifier is used to differentiate between background and tissue signals in the ANAT image. In order to account for the noise effect, a probabilistic model is used to model the C-SENC signal intensities. The well-known MRI signal model that uses Rician and Rayleigh probability density functions to model the tissue and the background signals, respectively, was used [8]. Using the fact that the LT and HT images are acquired independently, we can easily show that the joint density function for their signal intensities (at the same pixel location) can be written as follows [9], fS1,S2(S1S2|tissue)= fS1(S1|tissue) . fS2 (S2|tissue) = S1 +S2 .e p2.sinc(∂ω)2 + p2.sinc(1−∂ω)2 2σ2 σ4 p.sinc(∂ω).S1 .e S12+S22 2σ2 . p.sinc(1−∂ω).S2 I0( ) .I0( ) (1) σ2 σ2 fS1,S2(S1S2|background)=fS1(S1| background) . fS2 (S2| background) fS1,S2(S1S2| background)= S1 +S2 σ4 .e S12 + S22 2σ2 (2) where S1 and S2 are the signals acquired from the LT and HT images, respectively; σ is the standard deviation of the background region, ∂ω represents the contractility of the heart tissue at the pixel location where S1 and S2 are acquired, and I0 is the first kind zero order Bessel function. A feature vector ν = [S1(x,y), S2(x,y)] is used to represent the information available for each pixel in the ANAT image. All feature vectors are then classified into two classes (background and tissues) as follows. First, a Bayesian discriminant function is built using the joint probability functions in Eq. (1) and (2): ∂ν = log (fS1,S2(S1,S2|tissue))–log (fS1,S2(S1,S2|background)) (3) So, the decision rule for the classification becomes: bckground, ∂ν < 0 pixel(x, y) ∈ { tissue , ∂ν > 0 (4) The Bayesian classifier identifies the tissue (non background) [2] in the C-SENC images. C. Fuzzy C-Means Fuzzy C-means (FCM) is a data clustering technique wherein each data point belongs to a cluster to some degree that is specified by a membership grade. This technique groups data points that populate some multidimensional space into a specific number of different clusters. FCM attempts to cluster feature vector by iteratively minimizing an objective function. FCM generates for each data element x in the feature space, a membership vector µx = [µ1x, µ2x…µcx], that describes how strong it belongs to each cluster. µkx denotes the similarity of pattern x to the cluster k and is calculated as follows: 1 µik = (5) 1 ∑cq=1 ( dik ) diq images. Otsu’s method uses an exhaustive search to evaluate the criterion for maximizing the between-class variance. An image is a 2D grayscale intensity function, and contains N pixels with gray levels from 1 to L. The number of pixels with gray level i is denoted ni, giving a probability of gray level i in an image of p i = ni ⁄ N (6) In the case of bi-level thresholding of an image, the pixels are divided into two classes, C1 with gray levels [1, …, t] and C2 with gray levels [t+1, …, L]. Then, the gray level probability distributions for the two classes are C1 : p1 ⁄ω1 (t) , … pt ⁄ω1 (t) C2 : pt+1 ⁄ω2 (t) , pt+2 ⁄ω2 (t) where ω1 (t) = ∑ti=1 pi and ω2 (t) = ∑Li=t+1 pi , and … pL ⁄ω2 (t), (7) (8) Also, the means for classes C1 and C2 are μ1 = ∑ti=1 i pi ⁄ω1 (t) , and μ2 = ∑Li=t+1 i pi ⁄ω2 (t) (9) (10) Let µT be the mean intensity for the whole image. It is easy to show that ω1 μ1 + ω2 μ2 = μT μ1 + μ2 = 1 (11) (12) Otsu defined the between-class variance [11] of the thresholded image as 2 σB 2 = ω1 (μ1 − μT ) + ω2 (μ2 − μT ) 2 (13) For bi-level thresholding, Otsu verified that the optimal threshold t* is chosen so that the between-class variance σB 2 is maximized; that is, t ∗ = Arg Max{σB } where 1≤t<𝐿 (14) III. MATERIALS AND METHODS A. Simulated C-SENC Images Simulated C-SENC MR images were created in MATLAB R2009B (MathWorks, Inc.) to test the proposed clustering technique. The simulated images were designed to represent short-axis with infarcts of different sizes. In order to prove the robustness of the proposed method, different levels of white Gaussian noise (0 – 50 %) were added to the images. And the smoothing filter was chosen to be Butterworth filter of first order. The clustering technique was tested on the simulated images. Fig.2 shows the resulting simulated images. (β−1) where β is called the exponent, diq can be calculated by any distance measure. Here, we use the Euclidean distance [10]. D. Otsu Thresholding Thresholding is a well-known technique for image segmentation that tries to identify and extract a target from its background on the basis of the distribution of gray levels in image objects. Otsu’s method chooses the optimal thresholds by maximizing the between-class variance with an exhaustive search [11]. Reference [12] concluded that Otsu’s method was one of the best threshold selection methods for general real world NT LT HT Infarction Map Fig. 2. Simulated C-SENC images and the resulting infarction map. Intensity gray levels are predefined by the user. Bright regions in the NT, LT, and HT images represent: infarction (or blood), akinetic, and contracting tissues, respectively. Infarction size is 2.94 cm2. The following table shows the controls and input ranges for the simulator. All mappings between pixels and millimeters were made by assuming mm/pixel value of 1.28. TABLE I INPUT CONTROLS RANGES OF THE SIMULATOR Type Image Dimensions ROI Depth Inner Radius (Endocardium) Outer Radius (Epicardium) in pixels 256 x 256 64 x 64 0 - 10 20 30 in mm 327.68 x 327.68 81.92 x 81.92 0 – 12.8 25.6 38.4 intensities of different tissues in the No-Tuning (NT), Anatomy B. Signal Clustering Technique (ANAT), and High-Tuning (HT) C-SENC images. High = signal intensities greater than 0.8 inDetecting normalized images; and Low = signal intensities less Myocardium than 0.2 in normalized images. Masking Simple Addition Stage 1 Stage 2 Stage 3 Fig. 3. Classification and Clustering Procedure Figure 3 shows a schematic diagram of the proposed clustering technique, which consists of three main stages. The first stage of the proposed technique aims to detect and extract the left ventricle. This is done by the successive application of four sub-steps: Denoising, thresholding, morphological opening and boundary detection. TABLE II TISSUE TYPES OCCUPY DIFFERENT AND THEIR CHARACTERISTIC SIGNAL INTENSITIES IN THE USED IMAGES Type Blood Infarcted Functional Background ANAT Low High High Low NT High High Medium Low LT Low High low Low HT Low Low High Low Signal intensities of different tissues in the No-Tuning (NT), Anatomy (ANAT), and High-Tuning (HT) C-SENC images. High = signal intensities greater than 0.8 in normalized images; and Low = signal intensities less than 0.2 in normalized images. Denoising is performed on LT and HT images using Bayes Classifier to get denoised ANAT images with improved contrast-to-noise ratio (CNR) between myocardium and background. Then, automatic thresholding is applied using Otsu’s thresholding. Morphological opening is applied on the thresholded image. This aims to remove more noise pixels and to improve the myocardium boundaries so that they can be traced successfully in the next step. It removes holes with areas less than 50 pixels. The value 50 was chosen to be less than the minimum detectable infarction size that was defined experimentally. This step is applied for two successive times; the first time removes the small holes in the tissue while the second time does the same for the small holes in the background region. Finally, boundary tracing is applied to select the myocardium borders. This is done by using the radial sweep technique with 8-connectivity [13], [14]. All regions are traced, and then the most centralized region is selected to be the myocardium as shown in figure 4. a) b) In the second stage, anatomy (ANAT) image of the heart is constructed by adding the LT and HT images as described in [1]. Then, NT and ANAT Images are masked by myocardium boundaries to exclude all pixels outside the myocardium. This restricts the clustering to only two pixel types; functional and infarcted tissue. This is applied by ANDING the binary image that contains the myocardium only with the original ANAT and NT images, respectively. This results in two images (ANAT and NT) that contain only pixels corresponding to the myocardium tissue. The third stage of the proposed technique consists of further clustering the myocardium through the application of Fuzzy C-Means algorithm. In this stage, FCM is applied to divide the myocardium into two major clusters: contracting and non-contracting tissue, from which we can extract the infarcted regions. Each data point is represented by a 2D vector in the NTANAT normalized intensity space. This intensity vector is the input to the clustering technique, which assigns to each pixel some degree of membership between zero and one. The infarcts are extracted from the clustered images by assigning the pixels with membership value > 0.5 to the infarct cluster. C. Validation A consultant cardiologist helped in the validation of the proposed technique by marking the infarcted tissue regions in the real C-SENC MRI images. Infarcted regions were marked three times for each set. Infarctions extracted from the clustered images were compared with those extracted from the marked images on a pixel-by-pixel basis and statistical results were calculated. IV. RESULTS A. Simulated Images Results Proposed technique was applied to the simulated C-SENC images shown in figure 2. White Gaussian noise with various levels (0 – 50 %) was added. Different infarction sizes were assigned with various levels of added noise to get a total of 300 cases. Each case consisted of three images, NT, LT and HT with predefined grayscale levels. Each case was created and tested separately for 100 times. Then average results were taken. Accuracy and precision of the identified infarction were measured versus each noise level as shown in figure 5. c) Fig. 4. a) Morphologically opened image, b) image with boundary traced regions, c) Image showing the most centralized region that represents the left ventricle Fig. 5. Accuracy and precision corresponding to different Noise levels for detected Infarctions. It was observed that infarcted regions can be extremely small for an automated system to detect. So, we aimed not only to automate and improve the infarction detection level, but also to specify the minimum size of infarction that can be detected given some statistics of the images and their qualities. We selected a value of 85% to be our threshold. Any detection of the infarcted tissue with accuracy and precision equal to or greater than this value was considered as successful detection. Accordingly, the minimum size of infarction that was detected by the proposed technique according to this criterion was found to range from 76 to 177 pixels (124.52 mm2 – 290 mm2) at noise levels up to 30%. exceeds 30 % of the maximum intensity in simulated images, the technique is not able to detect the infarction with accuracy more than or even equal to 85%. Tissue of the myocardium detected as infarcted tissue indeed includes two clusters; infarct and hibernated (tissue that is not-contracting while still viable). It is clear that we are able to differentiate between contracting and noncontracting regions in the heart tissue, but still cannot differentiate between the hibernating and the infracted tissue as both of them are non-contracting tissues. Further clustering may be applied to differentiate between these two regions. In conclusion, a new technique is proposed for identifying different heart tissues from C-SENC functional and viability images. The technique is based on the consecutive application of the Otsu’s thresholding and FCM techniques. The technique is successfully applied to short-axis images of the heart as well as to simulated C-SENC images. It gives very good results even if the images are suffering from high noise levels. REFERENCES Fig. 6. Minimum Detectable Infarction size vs Noise Level. [1] B. Real MR Patient Results [2] [3] [4] NT LT HT Infarction Map Figure 7. Representative C-SENC MRI images from a patient with myocardial infarction. The resulting infarcted regions are colored in red. The first row shows the images and the infarction map for the proposed technique. The second row shows the markings of the consultant cardiologist who marked the infarcted regions in the C-SENC Images. Figure 7 shows real short-axis C-SENC images and the resulting infarcted regions colored in red. The resulting images correctly identified the pixels marked as infarct with accuracy of 92.14 – 98.46 % and precision of 84.22 – 89.94 %. Quantitative performance and visual comparisons demonstrate the robustness of the proposed technique for identifying different tissue types. V. DISCUSSION AND CONCLUSION The proposed technique was found to be robust in determining the existent infarction. Infarcted myocardium is specified only if there are enough data points in the infarct cluster during the application of the technique. For all the analyzed images, the technique correctly determines infarction existence. One advantage of the resulting clustered images is the excellent removal of the blood due to the black-blood property in the LT and HT images. Thus, the resulting clustered images would allow for accurate measurement of the infarct size. But when the noise level [5] [6] [7] [8] [9] [10] [11] [12] [13] [14] Osman NF, Sampath S, Atalar E, Prince JL. Imaging longitudinal cardiac strain on short-axis images using strain-encoding MRI. Magn Reson Med 2001; 46:324–334. Wu KC, Lima JA. Noninvasive imaging of myocardial viability: current techniques and future developments. Circ Res 2003; 93:1146– 1158. Watzinger N, Saeed M, Wendland MF, Akbari H, Lund G, Higgins CB. Myocardial viability: magnetic resonance assessment of functional reserve and tissue characterization. J Cardiovasc Magn Reson 2001; 3:195–208. Ibrahim, E.-S.H., Weiss, R.G., Stuber, M., Spooner, A.E., Osman, N.F.: Identification of Different Heart Tissues from MRI C-SENC Images Using an unsupervised Multi-Stage Fuzzy Clustering Technique. J. Magn. Reson. Imaging 28(2), 519–526 (2008). Motaal, A.G., El Gayar, N., Osman, N.F.: Automated Cardiac-Tissue Identification in Composite Strain-Encoded (C-SENC) Images Using Fuzzy C-means and Bayesian Classifier. iCBBE, Chengdu, China, 2010. Ibrahim EH, Stuber M, Kraitchman DL, Weiss RG, Osman NF. Combined functional and viability cardiac MR imaging in a single breathhold. Magn Reson Med 2007; 58:843–849. Duda RO, Hart PE. Pattern classification and scene analysis. New York,: Wiley; 1973. Sijbers J, Den Dekker A. J., Van Dyck D., Raman E. Estimation of signal and noise from Rician distributed data. Proc.Int. Conf. Signal Proc. and Comm., pp. 140- 142, Spain 1998. Ahmed S. Fahmy ―Background Noise Removal in Cardiac Magnetic Resonance Images Using Bayes Classifier. EMBC, Vancouver, August 2008. Bezdek JC, Hathaway RJ, Sabin MJ, Tucker WT. Convergence theory for fuzzy c-means: counterexamples and repairs. IEEE Trans Syst Man Cybern 1987;17:873–877. N. Otsu, A threshold selection method from gray-level histogram, IEEE Transactions on System Man Cybernetics, Vol. SMC-9, No. 1, 1979, pp. 62-66. Neamat El Gayar, Friedhelm Schwenker, and Gunther Palm. A Study of the Robustness of KNN Classifiers Trained Using Soft Labels. ANNPR 2006, LNAI 4087, pp. 67–80, 2006. M. Alder, An Introduction to Pattern Recognition. Osborne Park, Western Australia: HeavenforBooks.com, 1997, ch. T. Pavlidis, Algorithms for Graphics and Image Processing. Berlin, Germany: Springer Verlag, 1982, ch. 7.5.