Paper
7 March 2024 A cross-level semantic aggregation segmentation method in aquatic scenes
Shaowu Peng, Kuncheng Huang, Qiong Liu
Author Affiliations +
Proceedings Volume 13086, MIPPR 2023: Pattern Recognition and Computer Vision; 130860P (2024) https://doi.org/10.1117/12.3005349
Event: Twelfth International Symposium on Multispectral Image Processing and Pattern Recognition (MIPPR2023), 2023, Wuhan, China
Abstract
Semantic segmentation in aquatic scenes is key technology water environment monitoring. Small-scale object detection and segmentation in aquatic scenes are major challenges in semantic segmentation of water bodies. Current typical semantic segmentation methods often use multi-scale feature fusion operations, features of different scales from different network layers are aggregated, enabling the features to have both strong semantic representation from high-level features and strong feature detail expression capability from low-level features. However, current methods, although they focus on the details of small-scale objects, primarily rely on low-level features to determine the presence of objects in the network scale adaptation for small object detection, resulting in the loss of accuracy when using high-level semantic features for prediction. Moreover, cross-scale fusion does not depend on category characteristics. Therefore, existing methods are not ideal for semantic-constrained small object segmentation, such as water surface garbage and plant debris. Our method focuses on the cross-level semantic information aggregation and utilization for object segmentation in aquatic scenes, providing a new approach for small object segmentation in complex semantic environments. In aquatic scenes, the category of objects has strong contextual relevance. Therefore, this paper proposes a cross-level semantic aggregation network to address the problem of small object segmentation in aquatic scenes. The cross-level semantic aggregation method guides the high-level features to perform semantic aggregation using low-level features, enabling the aggregation of features with high-level semantic features of the same category as small objects, while introducing relevant contextual scene features of different categories. Compared to traditional scale fusion, this introduces a new aggregation method within the semantic framework to handle small object segmentation in complex contextual relationships. We conducted extensive experiments on our self-built water body scene dataset, ColorWater, and the public dataset Aeroscapes. In addition to achieving state-of-the-art performance in overall segmentation, we particularly achieved significant advantages in small object categories such as floating garbage on the water surface and plant debris, which are the focus of this paper.
(2024) Published by SPIE. Downloading of the abstract is permitted for personal use only.
Shaowu Peng, Kuncheng Huang, and Qiong Liu "A cross-level semantic aggregation segmentation method in aquatic scenes", Proc. SPIE 13086, MIPPR 2023: Pattern Recognition and Computer Vision, 130860P (7 March 2024); https://doi.org/10.1117/12.3005349
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Semantics

Feature fusion

Image segmentation

Correlation coefficients

Environmental monitoring

Feature extraction

Ablation

RELATED CONTENT


Back to Top