A multi-plane 2D medical image segmentation method combined with transformers

Zengxin Liu; Caiwen Ma; Wenji She

doi:10.1117/12.3029806

21 June 2024 A multi-plane 2D medical image segmentation method combined with transformers

Zengxin Liu, Caiwen Ma, Wenji She

Proceedings Volume 13167, International Conference on Remote Sensing, Mapping, and Image Processing (RSMIP 2024); 131672Q (2024) https://doi.org/10.1117/12.3029806
Event: International Conference on Remote Sensing, Mapping and Image Processing (RSMIP 2024), 2024, Xiamen, China

Abstract

Segmentation on medical image is a necessary prerequisite for disease diagnosis and treatment planning. In various medical image segmentation tasks, U-Net based on convolutional neural network (CNN) has achieved tremendous success due to its ability to learn image details and deep high-dimensional features. However, the inherent limitations of convolution operations limit their performance in modeling explicit long-term relationships. Especially in the brain MRI glioma segmentation task, traditional convolutional neural networks show weakness in learning global semantic information due to the extreme intrinsic heterogeneity of tumors in terms of appearance, shape, and histology. Therefore, this research proposes a 2D U-Net combined with transformer for brain tumor segmentation, and also designs a fusion module to better fuse the high-resolution detail features from the encoder with the high-level semantic features in the decoding process. The respective segmentation models are trained on the three orthogonal planes, and a tumor core-assisted network is separately trained. We validate proposed method on the BraTS20 brain glioma MRI dataset, and the experimental results demonstrate that our method outperforms state-of-the-art 2D methods. Compared with 3D methods, our model can accomplish accurate tumor segmentation while saving computational resources.

(2024) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Zengxin Liu, Caiwen Ma, and Wenji She "A multi-plane 2D medical image segmentation method combined with transformers", Proc. SPIE 13167, International Conference on Remote Sensing, Mapping, and Image Processing (RSMIP 2024), 131672Q (21 June 2024); https://doi.org/10.1117/12.3029806

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
7 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Image segmentation

Tumors

3D modeling

Transformers

Brain

Magnetic resonance imaging

Medical imaging

Show All Keywords

Keywords/Phrases

Search In:

Publication Years