Makeup transfer based on Laplacian pyramid network

Yan Chen; Wenhui Gong; Mohammad S. Alam; Jun Sang

doi:10.1117/12.2663756

13 June 2023 Makeup transfer based on Laplacian pyramid network

Yan Chen, Wenhui Gong, Mohammad S. Alam, Jun Sang

Proceedings Volume 12527, Pattern Recognition and Tracking XXXIV; 125270T (2023) https://doi.org/10.1117/12.2663756
Event: SPIE Defense + Commercial Sensing, 2023, Orlando, Florida, United States

Conference Poster

Abstract

Makeup transfer aims to extract a specific makeup from a face and transfer it to another face, which can be widely used in portrait beauty, and cosmetics marketing. At present, existing methods can achieve the transfer of the entire facial makeup, but the quality of makeup transfer is not excellent because there may be a mismatch between the two images. In this paper, we propose a facial makeup transfer network based on the Laplacian pyramid, which can better preserve the facial structure from the source image and achieve high-quality transfer results. The model consists of three parts: makeup feature extraction, facial structure feature extraction, and makeup fusion. The makeup extraction part is used to extract the facial makeup from the reference image. And the facial structure feature extraction part is used to extract facial structure from the source image, in order to solve the loss of facial details when extracting facial structural features, we used the method based on Laplacian Pyramid. The makeup fusion part will fuse the facial makeup with facial structure features. Many experiments on the MT dataset have shown that this method can transfer makeup successfully without changing the original facial structure, and achieve advanced performance in various makeup styles.

Citation Download Citation

Yan Chen, Wenhui Gong, Mohammad S. Alam, and Jun Sang "Makeup transfer based on Laplacian pyramid network", Proc. SPIE 12527, Pattern Recognition and Tracking XXXIV, 125270T (13 June 2023); https://doi.org/10.1117/12.2663756

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available