23 October 2024 Semi-supervised Chinese poem-to-painting generation via cycle-consistent adversarial networks
Zhengyang Lu, Tianhao Guo, Feng Wang
Author Affiliations +
Abstract

Classical Chinese poetry and painting represent the epitome of artistic expression, but the abstract and symbolic nature of their relationship poses a significant challenge for computational translation. Most existing methods rely on large-scale paired datasets, which are scarce in this domain. We propose a semi-supervised approach using cycle-consistent adversarial networks to leverage the limited paired data and large unpaired corpus of poems and paintings. The key insight is to learn bidirectional mappings that enforce semantic alignment between the visual and textual modalities. We introduce novel evaluation metrics to assess the quality, diversity, and consistency of the generated poems and paintings. Extensive experiments are conducted on a new Chinese Painting Description Dataset. The proposed model outperforms previous methods, showing promise in capturing the symbolic essence of artistic expression.

© 2024 SPIE and IS&T
Zhengyang Lu, Tianhao Guo, and Feng Wang "Semi-supervised Chinese poem-to-painting generation via cycle-consistent adversarial networks," Journal of Electronic Imaging 33(5), 053056 (23 October 2024). https://doi.org/10.1117/1.JEI.33.5.053056
Received: 31 May 2024; Accepted: 2 October 2024; Published: 23 October 2024
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Education and training

Semantics

Visualization

Data modeling

Adversarial training

Performance modeling

Gallium nitride

Back to Top