KEYWORDS: Imaging systems, RGB color model, Real time imaging, Spatial resolution, Cameras, Neural networks, Digital imaging, Image analysis, Spectral resolution, 3D acquisition
We develop a compact imaging system to enable simultaneous acquisition of the spectral and depth information in real time. Our system consists of a spectral camera with low spatial resolution and an RGB camera with high spatial resolution, which captures two measurements from two different views of the same scene at the same time. Relying on an elaborate computational reconstruction algorithm with deep learning, our system can eventually obtain a spectral cube with a spatial resolution of 1920×1080 and a total of 16 spectral bands in the visible light section, as well as the corresponding depth map with the same spatial resolution. Evaluations on both benchmark datasets and real-world scenes show that our reconstruction results are accurate and reliable. To the best of our knowledge, this is the first attempt to capture 5D information (3D space + 1D spectrum + 1D time) with a miniaturized apparatus and without active illumination.
Hyperspectral light field (HSLF) images with enriched spectral and angular information provide better representation of real scenes than conventional 2D images. In this paper, we propose a novel denoising method for HSLF images. The proposed method consists of two main steps. First, we generalize the intrinsic tensor sparsity (ITS) measure previously used for 3D hyperspectral image denoising to the 5D HSLF, by using the global correlation along the spectral dimension and the nonlocal similarity across the spatial and angular dimensions. Second, we further exploit the spatial-angular correlation by integrating light field super-resolution (SR) into the denoising process. In this way, the 5D HSLF can be better recovered. Experimental results validate the superior performance of the proposed method in terms of both objective and subjective quality on a self-collected HSLF dataset, in comparison with directly applying the state-of-the-art denoising methods.
Access to the requested content is limited to institutions that have purchased or subscribe to SPIE eBooks.
You are receiving this notice because your organization may not have SPIE eBooks access.*
*Shibboleth/Open Athens users─please
sign in
to access your institution's subscriptions.
To obtain this item, you may purchase the complete book in print or electronic format on
SPIE.org.
INSTITUTIONAL Select your institution to access the SPIE Digital Library.
PERSONAL Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.