With the abilities of feature extraction and nonlinear representation, deep neural networks can remove spatial redundancy efficiently and perform well in terms of visible image compression. However, when it comes to multispectral images, it is necessary to consider both spatial and spectral redundancy. Based on this point, we propose an end-to-end feature domain residual coding network for multispectral image compression based on interspectral prediction. Specifically, a spatial-spectral feature extraction network and an interspectral prediction network are designed based on a pyramid structure, which can capture and fuse multi-scale features from coarse to fine. They make the best use of the spectral correlation to predict images accurately while combining with the feature domain residual coding network, which can further reduce the redundancy of spatial-spectral information. A single loss function jointly optimizes all modules in the network. There are lots of experiments with 8-band and 12-band multispectral image datasets. The experimental results demonstrate that the compression performance of the proposed method is superior to traditional compression methods (JPEG2000, 3D-SPIHT, Versatile Video Coding, PCA+JPEG2000) across evaluation indicators and even better than the advanced learned multispectral image compression algorithms.
Multispectral images have numerous features and a wide range of applications. However, traditional image compression methods, such as JPEG2000 and 3D-SPIHT, do not make effective use of spectral information. We propose a deep compression framework based on interspectral prediction to take full advantage of spectral correlation when using temporal correlation for interframe prediction in video compression. First, two-dimensional and three-dimensional convolutions were used to obtain spatial and spectral information for predicting the original image. Then, we applied a residual neural network to compress the residual information of the image. Subsequently, a decoder was employed to reconstruct the multispectral image based on the compressed image and residual information. All components were jointly trained by a single loss function that considered the tradeoff between the compression bit rate and decoded image quality. The experimental results showed that our proposed method outperformed other traditional compression algorithms, including JPEG2000, 3D-SPIHT, and PCA+JPEG2000, in terms of peak signal-to-noise ratio and spectral angle and is equivalent to or even better than some image compression algorithms based on deep neural networks.
With the continuous improvement of spatial and spectral resolution, the application of multispectral images has greatly increased in remote sensing. However, the amount of image data also increases sharply, which brings great pressure to data storage and transmission. To solve this issue, we propose an end-to-end image compression scheme according to spatial–spectral feature extraction, which can be implemented by a spatial–spectral memory unit (SSMU). Furthermore, to improve the feature extraction capability of this deep network, the multichannel grouping fusion module is adopted to reconstruct and fuse the image features. In the encoder of the proposed compression scheme, the SSMU first extracts spatial–spectral features along the spatial direction and the spectral direction, and the multichannel grouping fusion module extracts the spatial and spectral features of different levels by recombination and fusion of band features of multispectral images. Then, the extracted deep spatial and spectral features are compressed by downsampling. Next, the quantizer and entropy coding convert the data into a compressed bitstream. In the decoder, a reverse process is used to restore the original images. The experiments take the multispectral images of Landsat 8 and WorldView3 as the datasets to verify the superiority of our method and compare it with JPEG2000, 3D-SPIHT, and the CNN-based methods. The results show that the proposed method outperforms the JPEG2000, 3D-SPIHT, and CNN-based methods in PSNR, spectral similarity, and spectral angle mapping metrics at different bit rates.
Multispectral image compression can considerably reduce the volume of data and promote their application. However, conventional single-scale compression schemes, such as JPEG2000 and three-dimensional set partitioning in hierarchical tree (3D-SPIHT), do not accurately preserve the features of images due to the complex features of multispectral images. A compression framework based on adaptive multiscale feature extraction with a convolutional neural network is proposed. First, an adaptive multiscale feature extraction module, which is the basic component of the compression framework, is designed to extract the multiscale spatial–spectral features of the multispectral images and adaptively adjust the weights of the features according to the content of the images. Second, the encoder, which is composed of multiscale feature extraction modules, extracts the multiscale spatial–spectral features of the multispectral images, and the extracted features are quantized and encoded by the quantizer and the entropy coder to generate a compressed bitstream. Third, the decoder, which is structurally similar to the encoder, is utilized to recover the images. The rate-distortion optimizer is embedded in the encoder to control the trade-off between the rate loss and the distortion. The results of these experiments on multispectral images of the Landsat 8 satellite and the WorldView-3 satellite validate the better performance of our compression framework compared with the performances of conventional schemes, including JPEG2000 and 3D-SPIHT. In order to further verify the effectiveness of multiscale features, the framework is compared with a single-scale compression algorithm based on deep learning, the experimental results validate that the performance of the single-scale compression algorithm superior to the conventional schemes but inferior to our multiscale algorithm, which indicates that the multiscale features can significantly improve the performance of the compression algorithm.
An innovative VLSI architecture for JPEG-LS compression algorithm is proposed, which
implements real-time image compression either in near lossless mode or in lossless mode. The
proposed architecture mainly includes four parallel pipelines, in which four pixels from four
continuous lines could be processed simultaneously with a specific coding scan sequence, which
ensures low complexity and real-time data processing. Our VLSI architecture is implemented on a
Xilinx XC2VP30 FPGA. The experiment results show that our hardware system has the same results in
image quality and compression rate as the standard JPEG-LS method and the processing speed of our
system is four times more than that of traditional method.
Based on the analyses of the interferential multispectral imagery(IMI), a new compression algorithm based on
distributed source coding is proposed. There are apparent push motions between the IMI sequences, the relative shift
between two images is detected by the block match algorithm at the encoder. Our algorithm estimates the rate of
each bitplane with the estimated side information frame. then our algorithm adopts a ROI coding algorithm, in which
the rate-distortion lifting procedure is carried out in rate allocation stage. Using our algorithm, the FBC can be
removed from the traditional scheme. The compression algorithm developed in the paper can obtain up to 3dB's gain
comparing with JPEG2000 and significantly reduce the complexity and storage consumption comparing with
3D-SPIHT at the cost of slight degrade in PSNR.
Access to the requested content is limited to institutions that have purchased or subscribe to SPIE eBooks.
You are receiving this notice because your organization may not have SPIE eBooks access.*
*Shibboleth/Open Athens users─please
sign in
to access your institution's subscriptions.
To obtain this item, you may purchase the complete book in print or electronic format on
SPIE.org.
INSTITUTIONAL Select your institution to access the SPIE Digital Library.
PERSONAL Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.