跳到主要导航 跳到搜索 跳到主要内容

A Two-Stage Unified Refinement Framework with RS-Specific Priors for Remote Sensing Open-Vocabulary Segmentation

  • Northwestern Polytechnical University Xian
  • Xijing University

科研成果: 期刊稿件文章同行评审

摘要

Vision-language pre-trained models, particularly CLIP, have demonstrated remarkable zero-shot transfer capabilities across various image-level tasks, catalyzing the advancement of open-vocabulary semantic segmentation (OVSS) in remote sensing (RS). However, the direct deployment of CLIP to the RS domain is inherently constrained by the profound domain shift between terrestrial and overhead perspectives, as well as the intricate geometric heterogeneities regarding scale and orientation. To circumvent these limitations, we propose CDSeg, a robust framework tailored for RSOVSS. Central to this architecture is the Dual-Domain Feature Compensation Module (DDFCM), which integrates DINOv3 weights, pretrained on large-scale RS benchmarks, to augment CLIP with domain-specific semantic priors, effectively bridging the natural-to-satellite knowledge gap. Furthermore, we introduce a MambaVision-driven Cross Feature Fine-grained Interaction Module (CFFIM) to facilitate a unified refinement of spatial and category attributes, leveraging long-range dependency modeling to enhance the model’s discriminative power in unseen environments. To robustly manage the complexities of diverse orientations and scales, CDSeg incorporates a direction-aware rotation strategy and a Wavelet-Cross-Attention Enhanced Module (WCAEM) for high-fidelity multiscale feature decoding. Empirical evaluations on four public benchmarks demonstrate that CDSeg achieves state-of-the-art performance, while extensive ablation studies substantiate the synergistic contribution and indispensability of each component.

学术指纹

探究 'A Two-Stage Unified Refinement Framework with RS-Specific Priors for Remote Sensing Open-Vocabulary Segmentation' 的科研主题。它们共同构成独一无二的学术指纹。

引用此