Stereo matching with energy-minimizing snake grid for 3D face modeling

Shafik Huq; Besma Abidi; Ardeshir Goshtasby; Mongi A. Abidi

doi:10.1117/12.542471

25 August 2004 Stereo matching with energy-minimizing snake grid for 3D face modeling

Shafik Huq, Besma Abidi, Ardeshir Goshtasby, Mongi A. Abidi

Proceedings Volume 5404, Biometric Technology for Human Identification; (2004) https://doi.org/10.1117/12.542471
Event: Defense and Security, 2004, Orlando, Florida, United States

Abstract

An energy minimizing snake algorithm that runs over a grid is designed and used to reconstruct high resolution 3D human faces from pairs of stereo images. The accuracy of reconstructed 3D data from stereo depends highly on how well stereo correspondences are established during the feature matching step. Establishing stereo correspondences on human faces is often ill posed and hard to achieve because of uniform texture, slow changes in depth, occlusion, and lack of gradient. We designed an energy minimizing algorithm that accurately finds correspondences on face images despite the aforementioned characteristics. The algorithm helps establish stereo correspondences unambiguously by applying a coarse-to-fine energy minimizing snake in grid format and yields a high resolution reconstruction at nearly every point of the image. Initially, the grid is stabilized using matches at a few selected high confidence edge points. The grid then gradually and consistently spreads over the low gradient regions of the image to reveal the accurate depths of object points. The grid applies its internal energy to approximate mismatches in occluded and noisy regions and to maintain smoothness of the reconstructed surfaces. The grid works in such a way that with every increment in reconstruction resolution, less time is required to establish correspondences. The snake used the curvature of the grid and gradient of image regions to automatically select its energy parameters and approximate the unmatched points using matched points from previous iterations, which also accelerates the overall matching process. The algorithm has been applied for the reconstruction of 3D human faces, and experimental results demonstrate the effectiveness and accuracy of the reconstruction.

Citation Download Citation

Shafik Huq, Besma Abidi, Ardeshir Goshtasby, and Mongi A. Abidi "Stereo matching with energy-minimizing snake grid for 3D face modeling", Proc. SPIE 5404, Biometric Technology for Human Identification, (25 August 2004); https://doi.org/10.1117/12.542471

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available