Paper
20 April 2023 Segmentation of skin lesions image based on gated axial transformer and triple attention mechanism
Jun Qi, Zhenyuan Cao, Xueyan Li, Shuxu Guo
Author Affiliations +
Proceedings Volume 12602, International Conference on Electronic Information Engineering and Computer Science (EIECS 2022); 126021Z (2023) https://doi.org/10.1117/12.2668513
Event: International Conference on Electronic Information Engineering and Computer Science (EIECS 2022), 2022, Changchun, China
Abstract
In the segmentation of skin lesions, there are several difficult phenomena, such as blurred edges, hair occlusion, circular field of vision and diagnostic markers. In response to the above problems, we propose the Gated Axial Transformer with Comprehensive Attention (CA-GAT) to segment skin lesions. First, the U-Net encoder-decoder structure is used as the main framework, and the encoder primarily consists of axial transformer layers. The axial attention mechanism is able to efficiently grasp long-distance dependence while greatly reducing the computational complexity. The gating mechanism allows the model to learn accurate positional encodings without pre-training on large-scale datasets. Second, the triple attention mechanism is introduced into the decoder, thus enabling the model to better differentiate the lesion boundary. Finally, the Local-Global training strategy (LoGo) enables the model to better exclude external interference based on contextual information while improving model performance. We conducted experiments on ISIC2018 dataset. Compared with U-Net, CA-Net, MedT and CA-GAT without LoGo, the Dice coefficient of our model increases by 6.3%, 0.46%, 1.2% and 1.49% respectively, and other indicators are also improved. As indicated by the experiment, the model CA-GAT exhibits favorable segmentation performance.
© (2023) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Jun Qi, Zhenyuan Cao, Xueyan Li, and Shuxu Guo "Segmentation of skin lesions image based on gated axial transformer and triple attention mechanism", Proc. SPIE 12602, International Conference on Electronic Information Engineering and Computer Science (EIECS 2022), 126021Z (20 April 2023); https://doi.org/10.1117/12.2668513
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Transformers

Image segmentation

Skin

Convolution

Back to Top