TY - JOUR
T1 - Adaptive Feature Enhanced Multi-View Stereo With Epipolar Line Information Aggregation
AU - Wang, Shaoqian
AU - Li, Bo
AU - Yang, Jian
AU - Dai, Yuchao
N1 - Publisher Copyright:
© 2016 IEEE.
PY - 2024
Y1 - 2024
N2 - Despite the promising performance achieved by the learning-based multi-view stereo (MVS) methods, the commonly used feature extractors still struggle with the perspective transformation across different viewpoints. Furthermore, existing methods generally employ a 'one-to-many' strategy, computing the correlations between the fixed reference image feature and multiple source image features, which limits the diversity of feature enhancement for the reference image. To address these issues, we propose a novel Epipolar Line Information Aggregati(EIA) method. Specifically, we present a feature enhancement layer (EIA-F) that utilizes the epipolar line information to enhance image features. EIA-F employs a 'many-to-many' strategy, adaptively enhancing the reference-source feature pairs with diverse epipolar line information. Additionally, we propose a correlation enhancement module (EIA-C) to improve the robustness of correlations. Extensive experiments demonstrate that our method achieves state-of-the-art performance across multiple MVS benchmarks, particularly in terms of reconstruction integrity.
AB - Despite the promising performance achieved by the learning-based multi-view stereo (MVS) methods, the commonly used feature extractors still struggle with the perspective transformation across different viewpoints. Furthermore, existing methods generally employ a 'one-to-many' strategy, computing the correlations between the fixed reference image feature and multiple source image features, which limits the diversity of feature enhancement for the reference image. To address these issues, we propose a novel Epipolar Line Information Aggregati(EIA) method. Specifically, we present a feature enhancement layer (EIA-F) that utilizes the epipolar line information to enhance image features. EIA-F employs a 'many-to-many' strategy, adaptively enhancing the reference-source feature pairs with diverse epipolar line information. Additionally, we propose a correlation enhancement module (EIA-C) to improve the robustness of correlations. Extensive experiments demonstrate that our method achieves state-of-the-art performance across multiple MVS benchmarks, particularly in terms of reconstruction integrity.
KW - Epipolar line information aggregation (EIA)
KW - feature enhancement
KW - multi-view stereo
KW - perspective transformation
UR - http://www.scopus.com/inward/record.url?scp=85205923583&partnerID=8YFLogxK
U2 - 10.1109/LRA.2024.3471454
DO - 10.1109/LRA.2024.3471454
M3 - 文章
AN - SCOPUS:85205923583
SN - 2377-3766
VL - 9
SP - 10439
EP - 10446
JO - IEEE Robotics and Automation Letters
JF - IEEE Robotics and Automation Letters
IS - 11
ER -