TY - JOUR
T1 - Effective Road Segmentation with Selective State-Space Model and Frequency Feature Compensation
AU - Yang, Jing
AU - Liu, Ting
AU - Zhang, Lei
AU - Zhang, Yanning
N1 - Publisher Copyright:
© 1980-2012 IEEE.
PY - 2025
Y1 - 2025
N2 - Road segmentation from high-resolution remote sensing imagery is critical for tasks such as autonomous driving, urban planning, and geographic information systems. However, challenges such as intensity nonuniformity, pixel ambiguity, and the visual similarity between roads and natural features make accurate segmentation difficult. In this article, we propose a road segmentation framework built upon the Mamba architecture, integrating a novel frequency feature compensation (FFC) approach to improve segmentation performance. Specifically, we introduce a progressive FFC method, leveraging wavelet decomposition to capture fine-grained details by separating features into high- and low-frequency components. Multistage features extracted from the Mamba backbone are decomposed using this approach and progressively integrated to compensate for the essential details for accurate road segmentation. We also introduce a wavelet loss (WL) to improve the model's ability to capture fine structural variations in the frequency domain. Furthermore, we develop a spatial perception Mamba block (SPMB) to enhance the capture of spatial relationships. By seamlessly integrating global context and local structures with the selective state-space model and FFC, our framework significantly boosts road segmentation accuracy. Extensive experiments on three publicly available road segmentation datasets demonstrate that our method achieves state-of-the-art performance, surpassing existing approaches in segmenting complex roads.
AB - Road segmentation from high-resolution remote sensing imagery is critical for tasks such as autonomous driving, urban planning, and geographic information systems. However, challenges such as intensity nonuniformity, pixel ambiguity, and the visual similarity between roads and natural features make accurate segmentation difficult. In this article, we propose a road segmentation framework built upon the Mamba architecture, integrating a novel frequency feature compensation (FFC) approach to improve segmentation performance. Specifically, we introduce a progressive FFC method, leveraging wavelet decomposition to capture fine-grained details by separating features into high- and low-frequency components. Multistage features extracted from the Mamba backbone are decomposed using this approach and progressively integrated to compensate for the essential details for accurate road segmentation. We also introduce a wavelet loss (WL) to improve the model's ability to capture fine structural variations in the frequency domain. Furthermore, we develop a spatial perception Mamba block (SPMB) to enhance the capture of spatial relationships. By seamlessly integrating global context and local structures with the selective state-space model and FFC, our framework significantly boosts road segmentation accuracy. Extensive experiments on three publicly available road segmentation datasets demonstrate that our method achieves state-of-the-art performance, surpassing existing approaches in segmenting complex roads.
KW - Frequency decomposition
KW - Mamba
KW - road extraction
KW - road segmentation
KW - selective state-space model
UR - http://www.scopus.com/inward/record.url?scp=85213889478&partnerID=8YFLogxK
U2 - 10.1109/TGRS.2024.3521483
DO - 10.1109/TGRS.2024.3521483
M3 - 文章
AN - SCOPUS:85213889478
SN - 0196-2892
VL - 63
JO - IEEE Transactions on Geoscience and Remote Sensing
JF - IEEE Transactions on Geoscience and Remote Sensing
M1 - 5603813
ER -