19 September 2023 BcsUST: universal style transformation network for balanced content styles
Min Zhao, XueZhong Qian, Wei Song
Author Affiliations +
Abstract

Composition, color, and brushstrokes are the primary factors in evaluating and appreciating artwork and are vital points to be considered and addressed in arbitrary style transfer tasks. However, existing methods do not balance these elements well, so we propose an approach that balances content structure and style patterns for universal style transformation (BcsUST). Specifically, two lightweight encoders based on residual networks pass the extracted style and content features into the multi-domain structure attention module, which applies a self-attention mechanism to align the input features point by point followed by manifold alignment. A secondary alignment strategy is used to integrate global styles harmoniously into the semantic structure of the content, while obtaining content details to keep the structure intact. Then, the texture modulator generates style convolution parameters to dynamically adjust the filter within the micro-decoder feature subspace, injecting complex and flexible style signals for stylization to enrich the colors and form exquisite strokes. In addition, this work proposes a two-stage training strategy that introduces an artistic appreciation loss to further balance content structure and stylistic signals. Numerous qualitative and quantitative studies demonstrate that the BcsUST framework produces images that resemble the artists’ paintings more closely.

© 2023 SPIE and IS&T
Min Zhao, XueZhong Qian, and Wei Song "BcsUST: universal style transformation network for balanced content styles," Journal of Electronic Imaging 32(5), 053017 (19 September 2023). https://doi.org/10.1117/1.JEI.32.5.053017
Received: 12 May 2023; Accepted: 6 September 2023; Published: 19 September 2023
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Education and training

Semantics

Convolution

Feature extraction

Color

Ablation

Chemical composition

Back to Top