Rugularizing generalizable neural radiance field with limited-view images

Wei Sun, Ruijia Cui, Qianzhou Wang, Xianguang Kong, Yanning Zhang

科研成果: 期刊稿件文章同行评审

摘要

We present a novel learning model with attention and prior guidance for view synthesis. In contrast to previous works that focus on optimizing for specific scenes with densely captured views, our model explores a generic deep neural framework to reconstruct radiance fields from a limited number of input views. To address challenges arising from under-constrained conditions, our approach employs cost volumes for geometry-aware scene reasoning, and integrates relevant knowledge from the ray-cast space and the surrounding-view space using an attention model. Additionally, a denoising diffusion model learns a prior over scene color, facilitating regularization of the training process and enabling high-quality radiance field reconstruction. Experimental results on diverse benchmark datasets demonstrate that our approach can generalize across scenes and produce realistic view synthesis results using only three input images, surpassing the performance of previous state-of-the-art methods. Moreover, our reconstructed radiance field can be effectively optimized by fine-tuning the target scene to achieve higher quality results with reduced optimization time. The code will be released at https://github.com/dsdefv/nerf.

源语言英语
文章编号78
期刊Complex and Intelligent Systems
11
1
DOI
出版状态已出版 - 1月 2025

指纹

探究 'Rugularizing generalizable neural radiance field with limited-view images' 的科研主题。它们共同构成独一无二的指纹。

引用此