A method of line drawing generation and face optimization

Yuanpei Zhao; Mao Li

doi:10.1117/12.3011356

8 November 2023 A method of line drawing generation and face optimization

Yuanpei Zhao, Mao Li

Proceedings Volume 12923, Third International Conference on Artificial Intelligence, Virtual Reality, and Visualization (AIVRV 2023); 129232E (2023) https://doi.org/10.1117/12.3011356
Event: 3rd International Conference on Artificial Intelligence, Virtual Reality and Visualization (AIVRV 2023), 2023, Chongqing, China

Abstract

The exploration of stable diffusion model for generating traditional Chinese painting-style line drawings is a promising field. However, the results directly generated by fine-tuning the stable diffusion model using the line drawing dataset have flaws in details, especially on the face. These flaws include unclear faces, facial feature aliasing, and inability to show expression. Therefore, we propose a method of line drawing generation and face optimization based on stable diffusion and matting technology. The dataset we used for fine-tuning is divided into two parts: the whole character line drawing and the face part of the line drawing, The face mask is obtained by matting after generating line drawing using a fine-tuned stable diffusion model. Finally, the face part of the figure is redrawn in the mask area by inpainting to achieve the face optimization effect. Through the above steps, we can not only generate line drawing but also solve the problems of unclear faces, facial feature aliasing, and inability to show expression.

(2023) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Yuanpei Zhao and Mao Li "A method of line drawing generation and face optimization", Proc. SPIE 12923, Third International Conference on Artificial Intelligence, Virtual Reality, and Visualization (AIVRV 2023), 129232E (8 November 2023); https://doi.org/10.1117/12.3011356

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
9 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Diffusion

Education and training

Data modeling

Machine learning

Lithium

Systems modeling

Image processing

Show All Keywords

Keywords/Phrases

Search In:

Publication Years