29 October 2021 Resampling and super-resolution of hexagonally sampled images using deep learning
Author Affiliations +
Abstract

Super-resolution (SR) aims to increase the resolution of imagery. Applications include security, medical imaging, and object recognition. We propose a deep learning-based SR system that takes a hexagonally sampled low-resolution image as an input and generates a rectangularly sampled SR image as an output. For training and testing, we use a realistic observation model that includes optical degradation from diffraction and sensor degradation from detector integration. Our SR approach first uses nonuniform interpolation to partially upsample the observed hexagonal imagery and convert it to a rectangular grid. We then leverage a state-of-the-art convolutional neural network architecture designed for SR known as residual channel attention network (RCAN). In particular, we use RCAN to further upsample and restore the imagery to produce the final SR image estimate. We demonstrate that this system is superior to applying RCAN directly to rectangularly sampled LR imagery with equivalent sample density. The theoretical advantages of hexagonal sampling are well known. However, to the best of our knowledge, the practical benefit of hexagonal sampling in light of modern processing techniques such as RCAN SR is heretofore untested. Our SR system demonstrates a notable advantage of hexagonally sampled imagery when employing a modified RCAN for hexagonal SR.

© 2021 Society of Photo-Optical Instrumentation Engineers (SPIE) 0091-3286/2021/$28.00 © 2021 SPIE
Dylan Flaute, Russell C. Hardie, and Hamed Elwarfalli "Resampling and super-resolution of hexagonally sampled images using deep learning," Optical Engineering 60(10), 103105 (29 October 2021). https://doi.org/10.1117/1.OE.60.10.103105
Received: 7 July 2021; Accepted: 11 October 2021; Published: 29 October 2021
Lens.org Logo
CITATIONS
Cited by 1 scholarly publication.
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
RGB color model

Sensors

Lawrencium

Optical transfer functions

Super resolution

Data modeling

Image processing

RELATED CONTENT


Back to Top