International Journal of Engineering Trends and Technology (IJETT) - Volume4 Issue7- July 2013 Image Resolution Enhancement Technique Based on the Interpolation of the High Frequency Subbands Obtained by DWT Mrs.S.Sangeetha#1, Mr.Y. Hari Krishna*2, # M.Tech Student, ECE Dept., BIT Institute of Technology, Hindupur. Anantapur (Dist), Andhra Pradesh, India. Abstract— In this correspondence, the authors propose an image resolution enhancement technique based on interpolation of the high frequency sub band images obtained by discrete wavelet transform (DWT) and the input image. The edges are enhanced by introducing an intermediate stage by using stationary wavelet transform (SWT). DWT is applied in order to decompose an input image into different sub bands. Then the high frequency sub bands as well as the input image are interpolated. The estimated high frequency sub bands are being modified by using high frequency sub band obtained through SWT. Then all these sub bands are combined to generate a new high resolution image by using inverse DWT (IDWT). The quantitative and visual results are showing the superiority of the proposed technique over the conventional and state-of-art image resolution enhancement techniques. The main aim of this image resolution enhancement is to produce a high resolution image with high PSNR from a low resolution image. If we adopt this method of resolution enhancement this helps in viewing even a low resolution image with high clarity i.e in case of seeing satellite images. Keywords— DWT, SWT, PSNR, IDWT, WZP, Interpolation. I. INTRODUCTION DWT decomposes an image into different subband images, namely low-low (LL), low-high (LH), high-low (HL), and high-high (HH). Another recent wavelet transform which has been used in several image processing applications is stationary wavelet transform (SWT). In short, SWT is similar to DWT but it does not use down-sampling, hence the subbands will have the same size as the input image. In this work, we are proposing an image resolution enhancement technique which generates sharper high resolution image. The pro-posed technique uses DWT to decompose a low resolution image into different subbands. Then the three high frequency subband images have been interpolated using bicubic interpolation [5], [6]. The high frequency sub-bands obtained by SWT of the input image are being incremented into the interpolated high frequency subbands in order to correct the estimated coefficients. Resolution has been frequently referred as an important aspect of an image. Images are being processed in order to obtain more enhanced resolution. One of the commonly used techniques for image resolution enhancement is Interpolation. Interpolation has been widely used in many image processing applications such as facial reconstruction, multiple description coding, and super resolution. There are three well known interpolation techniques, namely nearest neighbor interpolation, bilinear interpolation, and bicubic interpolation. In parallel, the input image is also interpolated separately. Finally, corrected interpolated high frequency Subbands [4] and interpolated input image are combined by using inverse DWT (IDWT) to achieve a high resolution output image. The proposed technique has been compared with conventional and state-of-art image resolution enhancement techniques. In this technique input image is interpolated beforehand, because it is seen that when a resolution comparison of input image alone with interpolated input image is done, the resolution seems to be more for interpolated image Image resolution enhancement in the wavelet than original image so input image is interpolated domain is a relatively new research topic and by bicubic interpolation [5], [6]. The conventional techniques used are the recently many new algorithms have been proposed. following: Discrete wavelet transform (DWT) is one of the recent wavelet transforms used in image processing. ISSN: 2231-5381 http://www.ijettjournal.org Page 3061 International Journal of Engineering Trends and Technology (IJETT) - Volume4 Issue7- July 2013 i) interpolation techniques: bilinear second form of zero padding. It is also used in interpolation and bicubic interpolation; conjunction with zero-phase FFT window. ii) Wavelet zero padding (WZP). According to the quantitative and qualitative experimental results, the proposed technique over performs the aforementioned conventional techniques for image resolution enhancement. II. WZP & INTERPOLATION A Wavelet zero padding It is one of the simplest methods for image resolution enhancement. It assumes that the signal is zero outside the original support. The most common form of zero padding is to append a string of zero-valued samples to the end of sometimedomain sequence Zero padding is used in spectral analysis with transforms to improve the accuracy of the reported amplitudes, not to increase frequency resolution. Without zero- padding, input frequencies will be attenuated in the output. Zero padding in the time domain is equivalent to optimal interpolation in the frequency domain, which restores the correct amplitudes. Since the wavelet transform is defined for infinite length signals, finite length signals are extended before they can be transformed. One of the common extension methods is zero padding. Zero padding shifts the intersample spacing in frequency of the array that represents the result. Zero padding consists of extending a signal (or spectrum) with zeros. It maps a length N signal to a length M>N signal, but need not divide M. ZeroPad M, m(x) = x (m), 0≤m≤N-1 0, N≤m≤M-1 For example, ZeroPad10([1,2,3,4,5])=[1,2,3,4,5,0,0,0,0,0] The above definition is natural when x(n) represents a signal starting at time 0 and extending for N samples. If, on the other hand, we are zero-padding a spectrum, or we have a timedomain signal which has nonzero samples for negative time indices, then the zero padding is normally inserted between samples (N1)/2 and (N+1)/2 for N odd and similarly for N even that is for spectra, zero padding is inserted at the point Z=-1(w=πf0). Below figure illustrates the ISSN: 2231-5381 Fig: 1 Illustration of frequency domain zero padding fig a Original spectrum x=[3,2,1,1,2] plotted over the domain k є (0,N-1) where N=5 fig b Zeropad11(X) fig c The same signal interpolated over the domain k є [(N-1)/2,(N-1)/2] which is more natural for interpreting negative frequencies fig d Zeropad11(X) plotted over the zero centered domains. In image resolution enhancement, wavelet transform of a low resolution (LR) image is taken and zero matrices are embedded into the transformed image, by discarding high frequency sub bands through the inverse wavelet transform and thus high resolution (HR) image is obtained. Input Image (LR) Wavelet Transform WZP Output Image (HR) Inverse Wavelet Transform Fig 2 Wavelet zero padding 1) Drawback i) The discontinuities are artificially created at the border. ii) The shift can cause problems if it alters the array positions relative to the frequency of interest. B Interpolation Interpolation is the process of using known data to estimate values at unknown locations. Interpolation method select new pixel from surrounding pixels. Mainly there are two types of interpolation algorithms 1) Adaptive algorithms i) This algorithm changes depending on what they are interpolating. http://www.ijettjournal.org Page 3062 International Journal of Engineering Trends and Technology (IJETT) - Volume4 Issue7- July 2013 ii) It involves lot of calculations 2) Non adaptive algorithms i) This algorithm interpolate by fixed pattern for all pixels. ii) It has the advantage of easy performance and low calculation cost. Non adaptive algorithm includes linear interpolation algorithms. Linear interpolation includes nearest neighbour, bilinear, Bicubic interpolation. In our project linear interpolation is used because of drawbacks in adaptive algorithm. C Nearest neighbor interpolation Fig: 3(a) Normal image Fig:3(b) jaggy edge distorted image E Bicubic interpolation It goes one step beyond bilinear by considering the closest 4x4 neighborhood of known pixels — for a total of 16 pixels. When these are at various distances from the unknown pixel, closer pixels are given a higher weighting in the calculation. Bicubic produces noticeably sharper images than the previous two methods, and is perhaps the ideal combination of processing time and output quality. For this reason it is a standard in many image editing programs (including Adobe Photoshop), printer drivers and in-camera interpolation. Suppose the function values f and the derivatives fx, fy and fxy are known at the four corners(0,0),(1,0),(0,1) and (1,1) of the unit square. The interpolated surface can then be written as It is the most basic interpolation technique and requires the least processing time of all the interpolation algorithms because it only considers one pixel — the closest one to the interpolated point. This has the effect of simply making each pixel bigger. Nearest neighbour interpolation is a simple method of multivibrate interpolation in one or two dimensions. The nearest neighbour algorithm selects the value The interpolation problem consists of determining the 16 of the nearest point and does not consider the values coefficients aij. of neighbouring points at all, yielding a piecewiseconstant interpolant. The algorithm is very simple to implement and is commonly used in real-time 3D rendering to select colour values for a textured surface. 1) Drawback It results in jagged edge distortion, where some information at the edges is lost. It can be seen in next page. D Bilinear interpolation It considers the closest 2x2 neighborhood of known pixel values surrounding the unknown pixel. It then takes a weighted average of these 4 pixels to arrive at its final interpolated value. This results in much smoother looking images than nearest neighbor. When all known pixel distances are equal, then the interpolated value is simply their sum divided by four. 1) Drawback: It results in more blurred images. Fig: 4 Bicubic interpolation on the square [0,3]x[0,3] consisting of 9 unit squares patched together. Bicubic interpolation is done as per MATLAB’s implementation. Colour indicates function value. The black dots are the locations of the prescribed data being interpolated and the color samples are not radially symmetric. As the more adjacent pixels it includes, the more accurate it can become. Hence in this project interpolation is done by bicubic interpolation. But this comes at the expense of much longer processing time. But images obtained by these linear interpolation technique produces many artifacts like blurring, blocking etc. Hence we do not depend on interpolation on a whole for image resolution enhancement. Along with it Discrete and stationary wavelet transform is used. 1) Advantages i) Bicubic interpolation creates smoother curves than bilinear interpolation, and introduces fewer ISSN: 2231-5381 http://www.ijettjournal.org Page 3063 International Journal of Engineering Trends and Technology (IJETT) - Volume4 Issue7- July 2013 "artifacts," or pixels that stand out as conspicuously deteriorating the apparent quality of the image. ii) When you need to increase the size of an image and time isn't important for example, if you're making prints from a digital camera on your own time bicubic interpolation provides the smooth results that are perceived as being of a higher quality. III. DWT & SWT A Discrete Wavelet Transform DWT [3] represents an arbitrary square integrable function as superposition of a family of basis functions called wavelets. A family of wavelet basis functions can be generated by translating and dilating the mother wavelet corresponding to the family. The DWT coefficients can be obtained by taking the inner product between the input signal and the wavelet functions. Since, the basis functions are translated and dilated versions of each other, a simpler algorithm, and known as Mallat’s tree algorithm or pyramid algorithm. In this algorithm, the DWT coefficients of one stage can be calculated from the DWT coefficients of the previous stage, which is expressed as follows: the mother wavelet. It is observed from Eq. 2 that j -th level DWT coefficients can be obtained from (j +1) -th level DWT coefficients. Compactly supported wavelets are generally used in various applications. In the first level of decomposition, one low pass sub image (LL2) and three orientation selective high pass sub images (LH2, HL2, and HH2) are created. DWT decomposes an image into a pyramid structure of sub images with various resolutions corresponding to the different scales. The inverse wavelet transform is calculated in the reverse manner, i.e., starting from the lowest resolution sub images, the higher resolution images are calculated recursively. We note that no separable wavelets have also been proposed in the literature. However, they are not widely used because of their complexity. LL LH HL HH Fig 5. Wavelet transforms decomposition of an image into 4 sub-images. Few applications of DWT are: i) Data compression, ii) ECG analysis, iii) Climatology, iv) Blood pressure etc. The below figure shows the 2D DWT Where W L (p, q) is p -th scaling coefficient at the q –th stage, W H (p, q ) is the p-th wavelet coefficient at q–th stage, h (n ) and g (n ) are the dilation coefficients corresponding to the scaling and wavelet functions, respectively. For computing the DWT coefficients of the discrete-time data, it is assumed that the input data represents the DWT coefficients of a high resolution stage. Eq. 1 can then be used for obtaining DWT coefficients of subsequent stages. In order to reconstruct the original data, the DWT Where coefficients are up sampled and passed through another set of low pass and high pass filters, which are expressed as: Fig. 6 2D - Discrete Wavelet Transform. 2 1 Downsample Columns 1 2 Downsample Rows X Convolve with filter X the rows of the entry X Convolve with filter X the rows of the entry Where h’ (n) and g’ (n) are respectively the low pass and high pass synthesis filter corresponding to B Stationary Wavelet Transform ISSN: 2231-5381 http://www.ijettjournal.org Page 3064 International Journal of Engineering Trends and Technology (IJETT) - Volume4 Issue7- July 2013 DWT has been employed in order to preserve the high frequency components of the image. The redundancy and shift invariance of the DWT mean that DWT coefficients are inherently interpolable. In this correspondence, one level DWT is used to decompose an input image into different subband images. Three high frequency subbands (LH, HL, and HH) contain the high frequency components of the input image. In the proposed technique, bicubic interpolation with enlargement factor of 2 is applied to high frequency subband images. Downsampling [2] in each of the DWT subbands causes information loss in the respective subbands. That is Few applications of SWT are: why SWT is employed to minimize this loss. i) Pattern recognition The interpolated high frequency Subbands [4] ii) Signal denoising and the SWT high frequency subbands have the same size which means they can be added with each other. The new corrected high frequency subbands can be interpolated further for higher enlargement. Using input image instead of low frequency subband increases the quality of the super resolved image. Below figure illustrates the block diagram of the proposed image resolution enhancement technique. By interpolating input image by α/2, and Fig.7. A 3 level SWT Filter Bank high frequency subbands by 2 and α in the intermediate and final interpolation stages respectively, and then by applying IDWT, the output image will contain sharper edges than the interpolated image obtained by interpolation of the Fig.8. SWT Filters input image directly. This is due to the fact that, the interpolation of isolated high frequency components IV. PROPOSED METHOD in high frequency subbands and using the In image resolution enhancement by using corrections obtained by adding high frequency interpolation the main loss is on its high frequency subbands of SWT of the input image, will preserve components (i.e., edges), which is due to the more high frequency components after the smoothing caused by interpolation. In order to interpolation than interpolating input image directly. increase the quality of the super resolved image, preserving the edges is essential. In this work, The Stationary wavelet transform (SWT) is a wavelet transform algorithm designed to overcome the lack of translation-invariance of the discrete wavelet transform (DWT). Translation-invariance is achieved by removing the downsamplers and upsamplers in the DWT and upsampling the filter coefficients by a factor of 2j-1in the jth level of the algorithm. The SWT is an inherently redundant scheme as the output of each level of SWT contains the same number of samples as the input – so for a decomposition of N levels there is a redundancy of N in the wavelet coefficients. ISSN: 2231-5381 http://www.ijettjournal.org Page 3065 International Journal of Engineering Trends and Technology (IJETT) - Volume4 Issue7- July 2013 Low Resolution Image SWT LL LH HL DWT LL HH LH HL HH Interpolation with factor 2 + Estimated LH + Estimated HL + Estimated HH IDWT Interpolation with factor Α/2 Interpolation with factor Α/2 High Resolution Image Fig: 9 Block diagram for proposed super resolution algorithm V. RESULTS AND DISCUSSION The super resolved image of lena’s picture using proposed technique in (fig d) is much better than the low resolution image in (fig a), super resolved image by using the interpolation (fig b), and WZP (fig c). (c) (d) Fig. 10. (a) Original low resolution Baboon’s image. (b) Bicubic interpolated image. (c) Super resolved image using WZP. (d) Proposed technique. Table 1 compares the PSNR performance of the proposed technique using bicubic interpolation with other resolution enhancement techniques: bicubic interpolation, WZP. In this project resolution of an image is measured in terms of PSNR. (a) (b) A PSNR PSNR values are used to measure the quality of an image. Peak signal-to-noise ratios (PSNR) have been implemented in order to obtain some ISSN: 2231-5381 http://www.ijettjournal.org Page 3066 International Journal of Engineering Trends and Technology (IJETT) - Volume4 Issue7- July 2013 quantitative results for comparison. PSNR is usually expressed in terms of logarithmic decibel value. A higher PSNR generally indicates that the reconstruction is of higher quality. TABLE 1 COMPARISON OF RESULTS Techniques used Lena (PSNR value) Bicubic interpolation Super resolved image using WZP Proposed technique (DWT & SWT) 26.867 29.27 We sincerely thank Mr. Sudarshan Raju, HOD ECE, BIT IT, Mr. Y. Hari Krishna, Asst. Professor, BIT IT, Mrs. C. Geetha, Associate Professor, Mrs. D. Manjula, Asst. Professor, MTIET, Palamaner, Chittoor, Principal MTIET, Management MTIET, Palamaner and the Staff members of ECE Dept. MTIET, family members, and friends, one and all who helped us to make this paper successful. REFERENCES [1] 35.82 [2] The results in Table I indicate that the proposed technique over performs the aforementioned conventional techniques. [3] VI. CONCLUSION This work proposed an image resolution enhancement technique based on the interpolation of the high frequency subbands obtained by DWT, correcting the high frequency subband estimation by using SWT high frequency subbands, and the input image. The proposed technique uses DWT to decompose an image into different subbands, and then the high frequency subband images have been interpolated. The interpolated high frequency subband coefficients have been corrected by using the high frequency subbands achieved by SWT of the input image. An original image is interpolated with half of the interpolation factor used for interpolation the high frequency subbands. Afterwards all these images have been combined using IDWT to generate a super resolved imaged. The proposed technique has been tested on well-known benchmark images, where their PSNR and visual results show the superiority of proposed technique over the other resolution enhancement techniques. The high resolution image thus obtained is used in i) remote sensing ii) medicine iii) military information acquisition iv) multimedia v) Satellite images etc. [4] [5] L. Yi-bo, X. Hong, and Z. Sen-yue, “The wrinkle generation method for facial reconstruction based on extraction of partition wrinkle line features and fractal interpolation,” in Proc. 4th Int. Conf. Image Graph., Aug. 22–24, 2007, pp. 933–937. Y. Rener, J. Wei, and C. Ken, “Downsample-based multiple description coding and post-processing of decoding,” in Proc. 27th Chinese Control Conf., Jul. 16–18, 2008, pp. 253–256. H. Demirel, G. Anbarjafari, and S. Izadpanahi, “Improved motionbased localized super resolution technique using discrete wavelet transform for low resolution video enhancement,” in Proc. 17th Eur. Signal Process. Conf., Glasgow, Scotland, Aug. 2009, pp. 1097–1101. Y. Piao, I. Shin, and H. W. Park, “Image resolution enhancement using inter-subband correlation in wavelet domain,” in Proc. Int. Conf. Image Process., 2007, vol. 1, pp. I-445–448. www.google.com. ABOUT AUTHORS 1. Mrs.S.Sangeetha received B.Tech degree from SVCET in 2009, Chittoor Dist, A.P, and India. She worked as Asst. Professor in Mother Theresa Institute of Engineering & Technology during 2009-11. She has 2 years’ experience in teaching field. Her Interested areas are Communications, Digital Image Processing, and VLSI. 2. Mr.Y. Hari Krishna is working as an Asst. Professor in Dept. of ECE, BIT IT, Anantapur (Dist), Hindupur, India. He did his B.Tech in BVCITS , Amalapuram and M.Tech in SKTRMCE, Mahaboobnagar (Dist), Kondair. He has 3 years’ experience in teaching field. His interested areas are DIP, Wireless Communications etc... He thought several subjects for under graduate students. ACKNOWLEDGMENT ISSN: 2231-5381 http://www.ijettjournal.org Page 3067