Implicit neural representation based on adaptive learnable filters

Yuhang Zheng; Ligen Shi; Chang Liu; Jun Qiu

doi:10.1117/12.3036225

22 November 2024 Implicit neural representation based on adaptive learnable filters

Yuhang Zheng, Ligen Shi, Chang Liu, Jun Qiu

Proceedings Volume 13239, Optoelectronic Imaging and Multimedia Technology XI; 1323908 (2024) https://doi.org/10.1117/12.3036225
Event: SPIE/COS Photonics Asia, 2024, Nantong, Jiangsu, China

Abstract

Implicit Neural Representation (INR) achieves the mapping between coordinates and signal values through multilayer perceptrons (MLPs). However, coordinate-based MLPs struggle with high-frequency information due to spectral bias. A common solution to the spectral bias problem is to use Fourier features with fixed encoding frequencies instead of spatial coordinates as inputs to the MLPs. Natural scenes exhibit distinct frequency spectra across local areas, with the main regions characterized by low frequencies and the edges by high frequencies. The fixed encoding frequency Fourier feature will lead to redundant input information and reduce the running speed of MLPs. Therefore, this paper proposes an Implicit Neural Representation with Adaptive Learnable Filters framework (NRALF), which is controlled by a learnable parameter to achieve low-pass, band-pass, high-pass, all-pass and all-no-pass functions. This filter filters the Fourier features of different frequencies, making the filtered coding space more sparse, thereby enhancing the expression ability of MLPs for natural scenes and significantly improving the convergence speed of MLPs. Experimental results show that the proposed method has higher accuracy and faster convergence speed in scene representation.

(2024) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Yuhang Zheng, Ligen Shi, Chang Liu, and Jun Qiu "Implicit neural representation based on adaptive learnable filters", Proc. SPIE 13239, Optoelectronic Imaging and Multimedia Technology XI, 1323908 (22 November 2024); https://doi.org/10.1117/12.3036225

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available