International Journal of Electrical and Computer Engineering (IJECE) Vol. No. June 2014, pp. ISSN: 2088-8708 An Optimal HSI Image Compression using DWT and CP Narmadha. Gayathri. Thilagavathi. Sardar Basha Departement of Electronics and Communication Engineering. Abdul Hakeem College of Engineering and Technology. Vellore. India Article Info ABSTRACT Article history: The compression of hyperspectral images (HSI. has recently become a very attractive issue for remote sensing applications because of their volumetric An efficient method for hyperspectral image compression is presented. The proposed algorithm, based on Discrete Wavelet Transform and CANDECOM/PARAFAC (DWT-CP), exploits both the spectral and the spatial information in the images. The core idea behind our proposed technique is to apply CP on the DWT coefficients of spectral bands of HSIs. We use DWT to effectively separate HSIs into different sub-images and CP to efficiently compact the energy of sub-images. We evaluate the effect of the proposed method on real HSIs and also compare the results with the wellknown compression methods. The obtained results show a better performance when comparing with the existing method PCA with JPEG 2000 and 3D SPECK. Received Feb 13, 2014 Revised May 6, 2014 Accepted May 23, 2014 Keyword: Compression DWT Hyperspectral Images Tensor Decomposition Copyright A 2014 Institute of Advanced Engineering and Science. All rights reserved. Corresponding Author: Narmadha. Departement of Electronics and Communication Engineering. Abdul Hakeem College of Engineering. Vellore. India. Email: srinana1822@gmail. INTRODUCTION Hyperspectral images are used in different practical applications such as the detection of the earthAos surface, soil type analysis, agriculture and forest monitoring, environmental studies and so on . There are two types of redundancy in the HSIs i. spatial and spectral redundancies. However, the spectral correlation . and redundanc. is generally but not always stronger than spatial correlation . Several compression methods have recently been proposed which can be classified into two main types as lossless and lossy compression methods. Lossless compression can only provide limited compression ratios, and the maximum achievable order is around three times . This ratio is not a reasonable value in many practical applications, especially in remote sensing. Traditional compression algorithms for HSIs have only considered the spectral value in a feature space whose dimensions were spectral bands. Then, dimension reduction was often applied . y means of Principal Component Analysis (PCA) or Independent Component Analysis (ICA) . However, they did not consider the spatial correlation when focusing on the spectral decorelation. Therefore, 3D wavelet-based techniques such as Set Partitioning in Hierarchical Tress (SPHIT) algorithm and and Set Partitioned Embedded block (SPECK) for hyperspectral image compression have been proposed to exploit a joint consideration of the spatial and spectral correlations . It has been shown in . that 3D-SPECK is better than 3D-SPIHT to achieve an efficient compression. In . , a PCA-based method in conjunction with JPEG2000 for compressing HSIs was introduced. The results reveal that the performance of the method is superior to that of the spectral DWT, and the best PCA performance occurs when a reduced number of PCs are retained and encoded. Another compression algorithm based on JPEG2000 for HSIs was proposed in . The algorithm can be applied for lossy and near-lossless compression applications in one single tool. It was also shown that the proposed scheme has a negligible effect on the results of selected applications . , hard classification, spectral unmixing, and anomaly detectio. In . a new lossy-toJournal homepage: http://iaesjournal. com/online/index. php/IJECE A ISSN: 2088-8708 lossless coder based on 3D Tarp-based Coding with classification for Embedding (TCE) coupled with the reversible integer-valued Karhunen-Loyve Transform (KLT) was introduced. The proposed method closely matches the lossy performance of JPEG2000 and outperformed JPEG2000 at lossless compression. An HSIs compression method based on band-of interest BOI-preserving- based was proposed in . Some bands of HSIs are more important in the specific applications, and BOI selection methods can be chosen according to application requirements. BOI and non-BOI bands are respectively compressed with low distortion and high In . the impact of lossy compression on spectral unmixing and supervised classification using Support Vector Machine (SVM) was investigated. It was shown that for certain compression techniques, a higher compression ratio (CR) may lead to more accurate classification results. A new group and region based parallel compression method for hyperspectral imagery was proposed in . Some compression methods currently consider HSIs as 3D data. Those compression methods are called a third-order tensor: two spatial dimensions and one spectral dimension. They try to take into account the spatial and spectral correlation of HSIs simultaneously and not alternatively as is the case for the above techniques . Several tensor decompositions have been introduced in . One of the most popular tensor decompositions is the Canonical decomposition (CP), which has been used for the compression of HSIs. allows the selection of any values for each dimension of the core tensor, which will be defined as in the next section and helps to obtain a higher compression ratio. Figure 1. Third-dimension modeling of HSIs. We propose a new HSIs compression algorithm based on discrete wavelet transform (DWT) and CP. Applying 2DWT to each spectral band will take care of first stage compression by using the . biorthogonal wavelet. Next. CP is applied to the four wavelet sub-images of the HSIs in order to achieve more CR. Finally, adaptive arithmetic coding (AAC) is used for coding the elements of the core tensors. We compare the proposed method with the best known techniques, such as the 3D-SPECK algorithm . , and both PCA and JPEG2000 . Our experimental results over the two most used HSIs (AVIRIS datasets: Cuprite and Moffett Fiel. demonstrate and confirm the effectiveness of our algorithm in providing a much smaller MSE for the desired set of CRs, especially when the CR is selected higher than 160, in this case the performance of the proposed algorithm is significantly better than the other techniques. The proposed method also increases the pixel-based supervised classification accuracy. 3D REPRESENTATION OF HYPERSPECTRAL IMAGES HSIs are the images generated by the imaging spectrometer by collecting image data simultaneously in hundreds of spectral bands or frequencies . 5Ae10 nm spectral widt. that reach a nearly contiguous spectral record. The large amount of bands increases the complexity and time of processing. HSIs can be represented as a third dimensional data OO as shown in Figure 1. Unlike natural images. HSIs have two types of correlation simultaneously, which are the spatial correlation within images and the spectral correlation between spectral bands. The spectral correlation is generally stronger than spatial correlation. The average correlation coefficient between two spectral bands of 3D-data cube can be measured as follows: IJECE Vol. No. June 2014 : 411 Ae 421 IJECE ISSN: 2088-8708 = 1 to For A :,:, :,:. End :,:, :,:, Oc In most HSIs datasets, such as AVIRIS data cube, the value of is higher than 0. 90 which means that the spectral correlation among bands is very high. Exploiting both of spectral and spatial correlations is the key for the success of a compression In this paper, a hybrid scheme based on DWT and CP for compression of HSIs is introduced. DWT and CP are briefly introduced in the next sections. Discrete Wavelet Transform (DWT) The DWT has successfully been used in many image processing applications including noise reduction, edge detection, and compression . Indeed, the DWT is an efficient decomposition of signals into lower resolution and details. From the the deterministic image processing point of view. DWT may be viewed as successive low-pass and high-pass filtering of the discrete time-domain signal. At each level, the high pass filter produces detailed information . orizontal (H), vertical (V) and diagonal (D) informatio. , while the low pass filter associated with scaling function produces the approximate (A) information. apply a two dimensional DWT to each band of HSIs. If each image band has rows and columns, then after applying the 2DWT, we obtain four sub-band images (A. D), each having AE2 rows and AE2 columns. The A sub-band images have the highest energy among all the coefficients of the other sub-band images. The 2DWT of function with of size and can be shown as Oc , , Oo2 2 Oo2 2 , , 2 Oc Oo2 2 Oo2 2 An Optimal HSI Image Compression using DWT and CP (D. Narmadh. A ISSN: 2088-8708 Figure 2. New decomposition scheme for HSIs. Table 1. 9/7 Biorthogonal Wavelet Filter I . O . I is called scaling function. The I , coefficients define an approximation of , . The , , coefficients add horizontal, vertical and diagonal details. Normally 2 is selected and so that are called wavelet filters. For the choice of wavelet filtering, the 0,1,2. A . The I and . biorthogonal wavelet which is used in JPEG2000, is selected in order to improve the compression ratio . Filter coefficients of . biorthogonal wavelet are shown in Table 1 . , . The inverse 2D-DWT is given by. , , Oc Oc Oc Oc , ) In lossy compression, we can ignore the detailed sub-bands . or example H. V and D) or preserve only important detailed information. In order to achieve a higher compression ratio, we can still decompose the images in more than one level. Nonnegative Tensor Decomposition In this section a brief review of the tensor model is presented. Important notations are shown in Table 2. The third-order TD tensor is described as a decomposition of a given third order tensor into an unknown core tensor OO multiplied by a set of three unknown component ,a OO . = 1, 2, . , represent common factors . matrices where IJECE Vol. No. June 2014 : 411 Ae 421 IJECE ISSN: 2088-8708 Table 2. Notations of Tensor Decomposition Notation Description Y. n-dimensional real vector space Third order Tensor n-mode matricization of tensor Y n-mode matrix in tucker model Outer product n-mode product of a tensor by matrix Figure 3. Fibers of the 3-order tensor Figure 4. Slices of a 3-order tensor Figure 5. CP decompositionof a 3 way array The CP decomposition factorizes a tensor into a sum of component rank-one tensors. For example, given a third-order tensor X C RIyJyK, we wish to write it as X C Eua Ab A c r A1 An Optimal HSI Image Compression using DWT and CP (D. Narmadh. A ISSN: 2088-8708 Figure 6. Third order Tensor Decomposition . Here tensor is an estimation of tensor, and it depends on the values, which are the dimensions of the core tensor, and tensor denotes the estimation error. Most algorithms for the Nonnegative Tensor Decomposition (NTD) model are based on Alternative Least Square (ALS) minimization of the squared Euclidean distance used as a global cost function subject to nonnegative constraints, that is: Here the objective is to find the optimal component matrices OO and the core tensor OO Almost all the existing algorithms for Tensor decompositions . require certain processing based on the full tensor during the estimation. The real-world data often contain millions of elements. Full data processing . uch as the inverse computatio. is therefore impractical. We use the Hierarchical Nonnegative Tensor Decomposition algorithm in proposed method. PROPOSED COMPRESSION ALGORITHM The compression is performed using four steps. In the first step, 2DWT is applied to each spectral band of the HSIs in order to obtain 4 sub-images . pproximate, diagonal, vertical and horizonta. for each spectral band . ee Figure . In the second step, the CP algorithm is applied to the four tensors. For each tensor, the size of the core tensor , i. (J1. J2. , was selected manually. The approximate tensor has the lowest frequency components containing most of the wavelet coefficient energy, so the values of (J1A. J2A. J3A) were set higher than those of other tensors. The values of (J1D. J2D. J3D) for the diagonal tensor, which contains the diagonal information, were also set higher than the (J1H. J2H. J3H) and (J1V. J2V. J3V) values of horizontal and vertical tensors. Computing CP Decomposition. As mentioned previously, there is no finite algorithm for determining the rank of a tensor . , consequently, the first issue that arises in computing a CP decomposition is how to choose the number of rank-one components. Most procedures fit multiple CP decompositions with different numbers of components until one is Augood. Ay Ideally, if the data are noise-free and we have a procedure for calculating CP with a given number of components, then we can do that computation for R = 1, 2, 3, . components and stop at the first value of R that gives a fit of 100%. Assuming the number of components is fixed, there are many algorithms to compute a CP Here we focus on what is today the AuworkhorseAy algorithm for CP: the alternating least squares (ALS) method proposed in the original papers by Carroll and Chang . and Harshman. For ease of IJECE Vol. No. June 2014 : 411 Ae 421 IJECE ISSN: 2088-8708 presentation, we only derive the method in the third-order case, but the full algorithm is presented for an Nway tensor in Figure 3 CR in this step can be considered as the ratio between the total number of bits in the original input data, and the number of bits must be transmitted and is shown as . In the third step, the 4 core tensors and 12 matrices should be transmitted. Most elements of the core tensors . specially diagonal, vertical and horizontal core tensor. are nearly zero. The bitplane coding procedure is used to transmit the elements of these core tensors . The bitplane coding includes two passes: the significant pass and the refinement. First, we define a significant map of a given threshold T and the element Suppose | represents the absolute value of the core tensor element at the location ( , , ) and represents the significant state for the threshold T . here T is an integer power of . 1, the is considered as the significant element. The significant element must For be encoded and removed from the core tensor, and the insignificant elements are preserved for the next After that, the significant threshold is divided in half, and the process is repeated for the next pass. This process is repeated until the energy of the encoded elements equal to or higher than 99. 5% of that of the original core tensor. The selected elements and their positions must be transferred. There are many possible approaches for coding a significant map. Most wavelet-based coders use adaptive arithmetic coding (AAC) for lossless entropy coding. We also use AAC for coding the significant element. Arithmetic coding is a variable-length lossless coding. Arithmetic coding does not require the transmission of codebook and so achieves a higher compression than Huffman coding. Arithmetic coding essentially amounts to computing the cumulative distribution function (CDF) of the probability of a sequence of symbols and then representing the resulting numerical value in a binary code. The columns of matrices are called in the proposed algorithm, which are normalized The absolute value of elements are in the range . , . , and they are very close to each other. , a uniform quantization is used. In the fifth step, the Therefore, in order to transfer the 12 matrices transmitted data are decoded. Finally in the sixth step, the inverse of 2DWT is applied to reconstruct the Proposed Algorithm (DWT-CP) Proposed Algorithm for Coder Input: Original HSIs . he size 1-Apply DWT to each spectral band to obtain 4 sub-images . pproximate, diagonal, vertical and horizontal AE2 2-Apply CP algorithm to the four tensors individually. Each tensor has the size of ( AE2 Input: Data tensor Y: (I1 y I2 y A A A y IN), rank R. Unfolding rule l = . 1, l2, . , lM] where lm = . , . , lm(K. ] Output: OO RN. N matrices A. OO RInyR Begin Stage 1: ,A. , min An Optimal HSI Image Compression using DWT and CP (D. Narmadh. A ISSN: 2088-8708 Stage 2: ,A. 1,2. A . Ia 1,2. A . 1,2. A , ,A. ,A, Ia End CP 4-Quantize and encode core tensor Using AAC Proposed Algorithm for Decoder 5-Decode the elements = I 6-Calculate the inverse 2DWT to reconstruct images. Output: Reconstructed images . COMPUTATIONAL COMPLEXITY In the following, we analyze the complexity of the algorithm. We considered an -tap filter bank and as the number of wavelet decomposition levels in the spatial band. The complexity of applying 2DWT to the tensor with the size of is O. N . -2 ) / . In the proposed algorithm we are using the . wavelet and also one level of decomposition, so the complexity of our algorithm is /7 . After applying 2DWT, each tensor . pproximate, diagonal, vertical and horizontal tensor. has the AE2 AE2 size of The max complexity of the TD is of order O( ), where is the average is the average of the dimensions of the approximate core number of pixels of the approximate tensor, and Table i. SNR. B) VALUES FOR. DWT-CP. PCA JPEG2000, 3D- SPECK Bpb DWT-CP DWT-TD PCA JPEG 2000 3D SPECK Method Cuprite Moffett Field DWT-CP DWT-TD PCA JPEG 2000 3D SPECK (J1A J2A J3A) Therefore, the total complexity of the proposed algorithm (DWT-CP) is of order 4 x O( IJECE Vol. No. June 2014 : 411 Ae 421 ) O. /7 . IJECE ISSN: 2088-8708 EXPERIMENTAL RESULTS Compression Results To measure the perceptual quality of images, the signal-to-noise ratio (SNR) can be well used. actually estimates the quality of the reconstructed images in comparison with the original ones . The SNR in dB is defined as . Figure 7. Classification accuracy of DWT-CP using SVM (RBF Kerne. Where =Oc Oc Oc Two popular AVIRIS datasets (Cuprite and Moffet. are used in our experiments. 2 These 16-bit radiance datasets have been cropped spatially to a size of 512 x 512 and composed of 224 spectral bands. First, we apply the proposed algorithm (DWT-CP) to these images. Next, we compare the SNRs achieved by the proposed algorithm with those obtained from the well-known techniques, i. 3D-SPECK , combined PCA JPEG2000 . on a set of HSIs. Table i shows the SNR versus different bpb for the Cuprite and Moffett HSIs. In our experiments. DWT-CP has significantly improved SNR at high CRs . mall bpb. especially when the CR is higher than 160 or bpb is lower than 0. DWTAaCP PCA JPEG2000 SAD. Rate. Figure 8. SAD (Ra. versus bpb for. DWT-CP and JPEG2000. An Optimal HSI Image Compression using DWT and CP (D. Narmadh. A ISSN: 2088-8708 CONCLUSION In this paper, we introduced a new method for HSIs compression using DWT and CP. This is carried out by reducing the size of 3D tensors computed from four wavelet sub-images of the spectral bands of HSIs. The performance of the proposed algorithm on AVIRIS datasets yields the following results: DWT-CP achieves higher SNR in comparison with two state-of-art algorithms . D-SPECK algorithm and combined PCA JPEG2. especially at bpb lower than 0. The proposed algorithm achieves a better pixel-based SVM classification accuracy. REFERENCES