The use of neural encodings has the potential to replace the commonly used polynomial fitting in the analysis of artwork surface based on Reflectance Transformation Imaging (RTI), as it has proved to result in more compact encoding with better relight quality, but it is still not widely used due to the lack of efficient implementations available to practitioners. In this work, we describe an optimized system to encode/decode neural relightable images providing interactive visualization in a web interface allowing multi-layer visualization and annotation. To develop it, we performed several experiments testing different decoder architectures and input processing pipelines, evaluating the quality of the results on specific benchmarks to find the optimal tradeoff between relighting quality and efficiency. A specific decoder has been then implemented for the web and integrated into an advanced visualisation tool. The system has been tested for the analysis of a group of ancient Roman bronze coins that present scarce readability and varying levels of preservation and that have been acquired with a multispectral light dome. Their level of corrosion and degradation, which in some cases hinders the recognition of the images, numerals, or text represented on them, makes the system testing particularly challenging and complex. Testing on such a real case scenario, however, enables us to determine the actual improvement that this new RTI visualization tool can offer to numismatists in their ability to identify the coins.
This contribution discusses the improvement approaches of Terahertz Time-Domain Spectroscopy (THz-TDS) to cultural heritage objects. The technique is gathering attention in the conservation field for its ability to retrieve information on material composition and surface topography in the far-infrared region (3-300 cm−1 ), but it can pose major challenges when applied on works of art. THz-TDS generates hyperspectral images that are corrupted by frequency-dependent blur and noise and are distorted by surface warping. These degradation effects can make the analysis of heterogeneous materials rather complicated because they substantially limit the frequency range where THz images have good spatial resolution and hinder the identification of materials. This work tackles these inherent limitations of the THz-TDS imaging and shows how to improve the analysis by computationally restoring the hyperspectral data. The experiments were undertaken using a bench-top THz-TDS instrument equipped with an advanced laser design and a precise mechanical delay stage that can achieve a peak dynamic range of 100 dB and a bandwidth of more than 6 THz. The exploitable region of frequencies is limited, however, between 0.2 and 3.5 THz because of the size of the THz beam waist and noise present at high frequencies. Such limitations were addressed by adopting a twofold computational strategy that involves (i) the removal of the surface warping and (ii) the application a fast deblurring-denoising algorithm for image restoration tailored to THz images. Experiments undertaken on an archaeological coin demonstrate how the approach effectively reduces degradation effects and how unwanted surface warping (whether it is a simple tilted plane or a more complex distortion) can be removed. The computational restoration of the images significantly improves their resolution, enabling the analysis above 4 THz. The application of such computational strategies makes possible the characterisation of artistic and archaeological materials up to 250 cm−1 . These results concretely open new possibilities in the use of THz spectroscopy imaging on objects with complex geometries and push the boundaries of THz data and image processing.
This work introduces a novel fast hyperspectral image deblurring and denoising approach tailored to archaeological applications of remote sensing. Hyperspectral data recorded by means of airborne or satelliteborne sensors can be used to detect buried archaeological deposits as the latter have a localised impact on the physical and chemical properties of the soil and the vegetation located above them, contributing to make them structurally different from the surrounding elements. By processing and analysing hyperspectral images, archaeological photo-interpreters can detect subtle changes in the properties of ground elements that can be attributed to the presence of subterranean archaeological sites. Hyperspectral imagery, while rich in content as far as the spectral characteristics of ground elements, often lacks in spatial resolution and contains blurring degradation and noise, prominent especially in some spectral regions. The influence of blur and noise highly effects not only the quality of the visual appearance of the represented objects and compromises the interpretation process, but impacts also further processing of imagery, limiting consequently the detection of targets of interest. The methodology here presented is based on the low-rank properties of hyperspectral images and fully exploits a sparse hyperspectral data representation linked with the self-similarity characteristics of image patches (small image parts). The restoration procedure additionally includes a bend-dependent formulation of blurring degradation. The preliminary results show high performances and reduced computational complexity, and that the proposed approach is able to cope with Gaussian and Poisson noise and band-dependent blur. By removing severe noise and blur, the accurate detection and interpretation of buried structures in different shapes and sizes is thus improved. The proposed approach significantly increases the number of hyperspectral bands that can be used for further image processing and analysis, providing new avenues for features of interest discoveries in bands where they normally obscured by noise.
Access to the requested content is limited to institutions that have purchased or subscribe to SPIE eBooks.
You are receiving this notice because your organization may not have SPIE eBooks access.*
*Shibboleth/Open Athens users─please
sign in
to access your institution's subscriptions.
To obtain this item, you may purchase the complete book in print or electronic format on
SPIE.org.
INSTITUTIONAL Select your institution to access the SPIE Digital Library.
PERSONAL Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.