Explore spatial-temporal relations: transient super-resolution with PMD sensors

Chaosheng Han; Xing Lin; Jingyu Lin; Chenggang Yan; Qionghai Dai

doi:10.1117/12.2071722

3 November 2014 Explore spatial-temporal relations: transient super-resolution with PMD sensors

Chaosheng Han, Xing Lin, Jingyu Lin, Chenggang Yan, Qionghai Dai

Proceedings Volume 9273, Optoelectronic Imaging and Multimedia Technology III; 927338 (2014) https://doi.org/10.1117/12.2071722
Event: SPIE/COS Photonics Asia, 2014, Beijing, China

Abstract

Transient imaging provides a direct view of how light travel in the scene, which leads to exciting applications such as looking around corners. Low-budget transient imagers, adapted from Time-of-Fight (ToF) cameras, reduce the barrier of entry for performing research of this new imaging modality. However, the image quality is far from satisfactory due to the limited resolution of PMD sensors. In this paper, we improve the resolution of transient images by modulating the illumination. We capture the scene under three linearly independent lighting conditions, and derive a theoretical model for the relationship between the time-profile and the corresponding 3D details of each pixel. Our key idea is that the light flight time in each pixel patch is proportional to the cross product of the illuminating direction and the surface normal. First we capture and reconstruct transient images by Fourier analysis at multiple illumination locations, and then fuse the data of acquired low-spatial resolution images to calculate the surface normal. Afterwards, we use an optimization procedure to split the pixels and finally enhance the image quality. We show that we can not only reveal the fine structure of the object but may also uncover the reflectance properties of different materials. We hope the idea of utilizing spatial-temporal relations will give new insights to the research and applications of transient imaging.

Citation Download Citation

Chaosheng Han, Xing Lin, Jingyu Lin, Chenggang Yan, and Qionghai Dai "Explore spatial-temporal relations: transient super-resolution with PMD sensors", Proc. SPIE 9273, Optoelectronic Imaging and Multimedia Technology III, 927338 (3 November 2014); https://doi.org/10.1117/12.2071722

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
10 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Sensors

Modulation

Image resolution

Super resolution

3D image processing

Light sources

Cameras

Show All Keywords

Keywords/Phrases

Search In:

Publication Years