TY - JOUR
T1 - CMDGAT
T2 - Knowledge extraction and retention based continual graph attention network for point cloud registration
AU - Zaman, Anam
AU - Yangyu, Fan
AU - Ayub, Muhammad Saad
AU - Irfan, Muhammad
AU - Guoyun, Lv
AU - Shiya, Liu
N1 - Publisher Copyright:
© 2022 Elsevier Ltd
PY - 2023/3/15
Y1 - 2023/3/15
N2 - Artificial Intelligence-based systems are required to interact with dynamic environments to continuously learn, retain and effectively utilize knowledge. Present AI-based systems scarcely exhibit this ability and mostly follow an isolated learning paradigm. In contrast, a human brain goes through a continual learning process by learning through experiences, retaining the learned knowledge, and using this knowledge on present tasks. Inspired by the learning of a human brain, we propose a continual learning methodology for point cloud registration which is a key component for 3D reconstruction and Augmented Reality (AR) localization. A major challenge that is faced in this context is the accurate correspondence of 3D points. Current learning-based registration techniques perform substantially, but these methods do not take into account the relations among point clouds obtained during sequential scans and perform registrations among point cloud pairs independently. Our proposed methodology increases the expressiveness of point clouds under consideration by using a novel continual graph network architecture with an attention mechanism that utilizes the learning from the association of the previous point cloud pairs to associate and register points in the current pair. The methodology implemented in PYTHON is evaluated on various challenging benchmark datasets including the Oxford, the 3DMatch, the KITTI, and the ETH dataset. The methodology is thoroughly evaluated under various scenarios including correspondence performance, registration performance, and generalization abilities. The results show a remarkable performance improvement as compared to the state-of-the-art methods. More critically, the proposed method offers exemplary globalization performance across unseen datasets and new scenarios.
AB - Artificial Intelligence-based systems are required to interact with dynamic environments to continuously learn, retain and effectively utilize knowledge. Present AI-based systems scarcely exhibit this ability and mostly follow an isolated learning paradigm. In contrast, a human brain goes through a continual learning process by learning through experiences, retaining the learned knowledge, and using this knowledge on present tasks. Inspired by the learning of a human brain, we propose a continual learning methodology for point cloud registration which is a key component for 3D reconstruction and Augmented Reality (AR) localization. A major challenge that is faced in this context is the accurate correspondence of 3D points. Current learning-based registration techniques perform substantially, but these methods do not take into account the relations among point clouds obtained during sequential scans and perform registrations among point cloud pairs independently. Our proposed methodology increases the expressiveness of point clouds under consideration by using a novel continual graph network architecture with an attention mechanism that utilizes the learning from the association of the previous point cloud pairs to associate and register points in the current pair. The methodology implemented in PYTHON is evaluated on various challenging benchmark datasets including the Oxford, the 3DMatch, the KITTI, and the ETH dataset. The methodology is thoroughly evaluated under various scenarios including correspondence performance, registration performance, and generalization abilities. The results show a remarkable performance improvement as compared to the state-of-the-art methods. More critically, the proposed method offers exemplary globalization performance across unseen datasets and new scenarios.
KW - 3D scene reconstruction
KW - Attention networks
KW - Continual learning
KW - Graph neural networks
KW - Point cloud registration
UR - http://www.scopus.com/inward/record.url?scp=85142426813&partnerID=8YFLogxK
U2 - 10.1016/j.eswa.2022.119098
DO - 10.1016/j.eswa.2022.119098
M3 - 文章
AN - SCOPUS:85142426813
SN - 0957-4174
VL - 214
JO - Expert Systems with Applications
JF - Expert Systems with Applications
M1 - 119098
ER -