Paper
16 February 2022 A semantic simultaneous localization and mapping system based on DeeplabV3+
Yongxing Jia, Mingcan Li, Jing Yu, Fenghui Xu
Author Affiliations +
Proceedings Volume 12083, Thirteenth International Conference on Graphics and Image Processing (ICGIP 2021); 120832Q (2022) https://doi.org/10.1117/12.2623143
Event: Thirteenth International Conference on Graphics and Image Processing (ICGIP 2021), 2021, Kunming, China
Abstract
There are many deep based semantic segmentation algorithms to strengthen robot perception. However, most existing methods hardly emphasis on the apply of deep neural networks. Therefore, this paper proposes a new Semantic Simultaneous Localization and Mapping system based on DeeplabV3+. The system can accurately reconstruct the 3D dense model of observed environment. Firstly, the Deeplabv3+ semantic extractor with the best visual effect is trained supervisedly, and the robot motion estimation is completed by the ORBSLAM2 framework. Subsequently, the semantic images, the depth images and the pose transformation matrix are sent to an efficient mapping module to fuse an accurate semantic model. Experimental results show that the constructed map can reflect the real distribution of objects in the scene, and the system perform well in the standard TUM datasets. The proposed method with loose coupling of novel segmentation networks can efficiently reduce the complexity of semantic SLAM system. Moreover, this method can improve the performance in the evolution of semantic segmentation network and SLAM framework.
© (2022) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Yongxing Jia, Mingcan Li, Jing Yu, and Fenghui Xu "A semantic simultaneous localization and mapping system based on DeeplabV3+", Proc. SPIE 12083, Thirteenth International Conference on Graphics and Image Processing (ICGIP 2021), 120832Q (16 February 2022); https://doi.org/10.1117/12.2623143
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Image segmentation

Associative arrays

Clouds

Image fusion

Classification systems

RGB color model

Visualization

RELATED CONTENT

Reasoning With Uncertainty About Textures
Proceedings of SPIE (January 05 1989)
Vision-based terrain learning
Proceedings of SPIE (May 09 2006)

Back to Top