TY - JOUR
T1 - Enhancing underwater single snapshot DOA estimation for limited dataset with modified knowledge distillation
AU - Zhang, Qinzheng
AU - Wang, Haiyan
AU - Shen, Xiaohong
AU - Yan, Yongsheng
AU - Zhu, Yingying
AU - Rindom Jensen, Jesper
N1 - Publisher Copyright:
© 2025 Elsevier Ltd
PY - 2025/3/1
Y1 - 2025/3/1
N2 - In recent years, the progress in DOA estimation using deep learning algorithms has attracted significant attention. However, their heavy reliance on extensive datasets poses a critical limitation, particularly in underwater settings where data collection is arduous. Furthermore, the lack of temporal correlation and statistical properties inherent in single-snapshot information lead to low accuracy in single-snapshot DOA estimation. To confront the above hurdles, this paper introduces an approach to improve the accuracy of underwater single snapshot DOA estimation with limited underwater datasets. By modifying the process structure and model characteristics of knowledge distillation (KD), we construct a new distillation structure that can bridge the gap between single snapshot data and multi-snapshot data sharing identical labels, achieving a breakthrough in compressing multi-snapshot data. This enhances the neural network's capacity to process both few-snapshot datasets and single-snapshot datasets. In addition, we designed novel input features to reduce the difficulty of CNN fitting by extracting the real and imaginary parts of the analytical signals, and integrated the array structure information to improve the generalization ability of our network in different scenarios. Besides, based on these innovations, we build a mapping framework between synthetic and real underwater datasets. This work involves second-order joint training of KD and transfer learning, which can help deal with small samples. The experiment results of our method show significant improvements in underwater DOA estimation accuracy, coupled with a marked reduction in overfitting risks associated with limited datasets. This work not only advances the application of deep learning in challenging underwater scenarios but also lays a foundation for future data-driven inference strategies.
AB - In recent years, the progress in DOA estimation using deep learning algorithms has attracted significant attention. However, their heavy reliance on extensive datasets poses a critical limitation, particularly in underwater settings where data collection is arduous. Furthermore, the lack of temporal correlation and statistical properties inherent in single-snapshot information lead to low accuracy in single-snapshot DOA estimation. To confront the above hurdles, this paper introduces an approach to improve the accuracy of underwater single snapshot DOA estimation with limited underwater datasets. By modifying the process structure and model characteristics of knowledge distillation (KD), we construct a new distillation structure that can bridge the gap between single snapshot data and multi-snapshot data sharing identical labels, achieving a breakthrough in compressing multi-snapshot data. This enhances the neural network's capacity to process both few-snapshot datasets and single-snapshot datasets. In addition, we designed novel input features to reduce the difficulty of CNN fitting by extracting the real and imaginary parts of the analytical signals, and integrated the array structure information to improve the generalization ability of our network in different scenarios. Besides, based on these innovations, we build a mapping framework between synthetic and real underwater datasets. This work involves second-order joint training of KD and transfer learning, which can help deal with small samples. The experiment results of our method show significant improvements in underwater DOA estimation accuracy, coupled with a marked reduction in overfitting risks associated with limited datasets. This work not only advances the application of deep learning in challenging underwater scenarios but also lays a foundation for future data-driven inference strategies.
KW - KD
KW - Single snapshot
KW - Small sample datasets
KW - Underwater DOA estimation
UR - http://www.scopus.com/inward/record.url?scp=85214665569&partnerID=8YFLogxK
U2 - 10.1016/j.apacoust.2025.110531
DO - 10.1016/j.apacoust.2025.110531
M3 - 文章
AN - SCOPUS:85214665569
SN - 0003-682X
VL - 231
JO - Applied Acoustics
JF - Applied Acoustics
M1 - 110531
ER -