跳到主要导航 跳到搜索 跳到主要内容

VDNeRF: Vision-Only Dynamic Neural Radiance Field for Urban Scenes

  • Northwestern Polytechnical University Xian
  • University of Oxford
  • Hefei University of Technology

科研成果: 期刊稿件 › 文章 › 同行评审

摘要

Neural radiance fields (NeRFs) implicitly model continuous three-dimensional scenes using a set of images with known camera poses, enabling the rendering of photorealistic novel views. However, existing NeRF-based methods encounter challenges in applications such as autonomous driving and robotic perception, primarily due to the difficulty of capturing accurate camera poses and limitations in handling large-scale dynamic environments. To address these issues, we propose vision-only dynamic NeRF (VDNeRF), a method that accurately recovers camera trajectories and learns spatiotemporal representations for dynamic urban scenes without requiring additional camera pose information or expensive sensor data. VDNeRF employs two separate NeRF models to jointly reconstruct the scene. The static NeRF model optimises camera poses and static background, whereas the dynamic NeRF model incorporates the 3D scene flow to ensure accurate and consistent reconstruction of dynamic objects. To address the ambiguity between camera motion and independent object motion, we design an effective and powerful training framework to achieve robust camera pose estimation and self-supervised decomposition of static and dynamic elements in a scene. Extensive evaluations on mainstream urban driving datasets demonstrate that VDNeRF surpasses state-of-the-art NeRF-based pose-free methods in both camera pose estimation and dynamic novel view synthesis.

源语言英语
页(从-至)1585-1599
页数15
期刊CAAI Transactions on Intelligence Technology
卷11
期5
DOI
出版状态已出版 - 10月 2026

学术指纹

探究 'VDNeRF: Vision-Only Dynamic Neural Radiance Field for Urban Scenes' 的科研主题。它们共同构成独一无二的学术指纹。

引用此