TY - JOUR
T1 - VL-MFL
T2 - UAV Visual Localization Based on Multisource Image Feature Learning
AU - Liu, Ganchao
AU - Li, Chao
AU - Zhang, Sihang
AU - Yuan, Yuan
N1 - Publisher Copyright:
© 1980-2012 IEEE.
PY - 2024
Y1 - 2024
N2 - Obtaining the Earth-fixed coordinates is a fundamental requirement for long-distance unmanned aerial vehicle (UAV) flight. Global navigation satellite systems (GNSSs) are the most common location model, but their signals are susceptible to interference from obstacles and complex electromagnetic environments. To solve this issue, a visual localization framework based on multisource image feature learning (VL-MFL) is proposed. In the proposed framework, the UAV is located by mapping airborne images to the satellite images with absolute coordinate positions. First, for the heterogeneity issues caused by different imaging environments of drone and satellite images, a lightweight Siamese network based on 3-D attention mechanism is proposed to extract consistent features from multisource images. Second, to overcome the problem of inaccurate localization caused by the large receptive field of traditional convolutional neural networks, the cell-divided strategy is imported to strengthen the position mapping relationship of multisource images features. Finally, based on similarity measurement, a confidence evaluation mechanism is established and a search region prediction method is proposed, which effectively improved the accuracy and efficiency in matching localization. To evaluate the location performance of the proposed framework, several related methods are compared and analyzed in detail. The results on the real-world datasets indicate that the proposed method has achieved outstanding location accuracy and real-time performance.
AB - Obtaining the Earth-fixed coordinates is a fundamental requirement for long-distance unmanned aerial vehicle (UAV) flight. Global navigation satellite systems (GNSSs) are the most common location model, but their signals are susceptible to interference from obstacles and complex electromagnetic environments. To solve this issue, a visual localization framework based on multisource image feature learning (VL-MFL) is proposed. In the proposed framework, the UAV is located by mapping airborne images to the satellite images with absolute coordinate positions. First, for the heterogeneity issues caused by different imaging environments of drone and satellite images, a lightweight Siamese network based on 3-D attention mechanism is proposed to extract consistent features from multisource images. Second, to overcome the problem of inaccurate localization caused by the large receptive field of traditional convolutional neural networks, the cell-divided strategy is imported to strengthen the position mapping relationship of multisource images features. Finally, based on similarity measurement, a confidence evaluation mechanism is established and a search region prediction method is proposed, which effectively improved the accuracy and efficiency in matching localization. To evaluate the location performance of the proposed framework, several related methods are compared and analyzed in detail. The results on the real-world datasets indicate that the proposed method has achieved outstanding location accuracy and real-time performance.
KW - Deep learning
KW - image matching
KW - unmanned aerial vehicle (UAV)
KW - Vicinagearth security
KW - visual localization
UR - http://www.scopus.com/inward/record.url?scp=85190171892&partnerID=8YFLogxK
U2 - 10.1109/TGRS.2024.3383509
DO - 10.1109/TGRS.2024.3383509
M3 - 文章
AN - SCOPUS:85190171892
SN - 0196-2892
VL - 62
SP - 1
EP - 12
JO - IEEE Transactions on Geoscience and Remote Sensing
JF - IEEE Transactions on Geoscience and Remote Sensing
M1 - 5618612
ER -