跳到主要导航 跳到搜索 跳到主要内容

DINO-MTP: Topology-Aware Multimodal Fusion of GPS Trajectories and Optical Imagery for Remote Sensing Road Extraction

  • Yiming Yao
  • , Peng Chu
  • , Jiayuan Li
  • , Zhen Wang
  • , Zhuhong You
  • Xijing University
  • Northwestern Polytechnical University Xian

科研成果: 期刊稿件文章同行评审

摘要

Accurate road extraction from remote sensing imagery is critical for urban mapping, navigation, and geospatial analysis, yet it remains highly challenging due to occlusions, thin and fragmented road structures, and the inherent limitations of single-modality data. To overcome these challenges, we propose DINO-MTP, a novel end-to-end framework that synergistically fuses GPS trajectory data with optical imagery for robust multimodal road extraction. Leveraging a self-supervised DINOv3 backbone, our approach introduces topology-aware and morphology-aware multimodal feature learning to explicitly address cross-modality heterogeneity, structural discontinuities, and background clutter. The framework incorporates a bidirectional attention alignment with modular attention masking to achieve deep semantic alignment and effective noise suppression within a unified embedding space. Additionally, it integrates spatial priors into channel attention to enhance the representation of elongated and interconnected road structures, while a feature-adaptive super-resolution pathway recovers fine details typically lost in conventional skip connections. An efficient dual-path cross-scale fusion module further ensures a coherent transition from global topology reconstruction to local geometric refinement. Extensive experiments and ablation studies on the BJRoad, RS-RGB-T and Porto datasets demonstrate that DINO-MTP consistently surpasses state-of-the-art unimodal and multimodal methods, delivering clearer, more continuous, and topologically faithful road network extraction in complex urban environments.

指纹

探究 'DINO-MTP: Topology-Aware Multimodal Fusion of GPS Trajectories and Optical Imagery for Remote Sensing Road Extraction' 的科研主题。它们共同构成独一无二的指纹。

引用此