An improved depth reconstruction method for unstable illumination environments in endoscopic surgeries

Shaowu Peng; Zeqi Li

doi:10.1117/12.3005340

7 March 2024 An improved depth reconstruction method for unstable illumination environments in endoscopic surgeries

Shaowu Peng, Zeqi Li

Proceedings Volume 13087, MIPPR 2023: Parallel Processing of Images and Optimization Techniques; and Medical Imaging; 1308707 (2024) https://doi.org/10.1117/12.3005340
Event: Twelfth International Symposium on Multispectral Image Processing and Pattern Recognition (MIPPR2023), 2023, Wuhan, China

Abstract

In the MIS (minimally invasive surgery), precise measurement and mastery of human organs is very important, even a slight wobble of instrument can cause a great deal of error. Digital 3D reconstruction technology can help doctor to confirm the real distance. Considering depth data is difficult to acquire and annotate on a large scale, especially in the human body scene, so many researches focus on self-supervised network. Most of them are based on a widely adopted hypothesis that Image brightness remains constant in adjacent frames, which cannot be satisfied in the body sense, with unstable lighting conditions in the narrow scale and complicated senses. To solve this problem, this paper proposes a high-precision depth reconstruction method for endoscopic surgical scenarios based on AFNet. Firstly, to overcome the limitations of the constant illumination assumption, we extract local features with illumination invariance and introduce quantization calculations for illumination-invariant feature descriptors in the loss function, to reduce the impact of illumination changes during the supervised process. Secondly, leveraging the synchronous movement of the light source and lens in the endoscope, we establish an association model between the brightness variation and depth prediction. This helps the network grasp the image context and smooth the depth better. Experiments show that our method improves the accuracy of depth estimation in endoscopic environments compared to baseline methods. The reconstruction effects on the ENDOVIS datasets of laparoscopic endoscopy and the ENDOSLAM datasets of gastrointestinal endoscopy are significantly improved.

(2024) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Shaowu Peng and Zeqi Li "An improved depth reconstruction method for unstable illumination environments in endoscopic surgeries", Proc. SPIE 13087, MIPPR 2023: Parallel Processing of Images and Optimization Techniques; and Medical Imaging, 1308707 (7 March 2024); https://doi.org/10.1117/12.3005340

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
8 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Light sources and illumination

Endoscopy

Surgery

Light sources

3D modeling

Endoscopes

Equipment

Show All Keywords

Keywords/Phrases

Search In:

Publication Years