TY - GEN
T1 - Flexible Sensor Network-Based Digital Human Reconstruction Using Spatiotemporal Attention Mechanism and Physical Constraints
AU - Li, Quanxing
AU - Wang, Lanjing
AU - Peng, Zicao
AU - Lu, Yuanxin
AU - Wang, Qingqing
AU - Ding, Shuo
AU - Yang, Haitao
N1 - Publisher Copyright:
© 2025 IEEE.
PY - 2025
Y1 - 2025
N2 - In recent years, significant progress in single-walled carbon nanotube (SWNT)-based flexible strain sensors has facilitated the development of low-cost, flexible, and wearable sensor networks for human motion sensing. However, due to the complex and nonlinear mapping between sensor outputs and human motion, accurately achieving digital human reconstruction from such sensor signals remains a challenging task. This paper proposes a spatiotemporal attention-based and physically constrained algorithm for digital human reconstruction using flexible sensor networks. An improved Transformer architecture is designed to model both temporal dynamics and spatial correlations among multiple sensors through a spatiotemporal attention mechanism. Furthermore, a composite loss function incorporating motion continuity and physical plausibility constraints is introduced to improve the smoothness and realism of predicted motion trajectories. The proposed method achieves real-time, end-to-end prediction of 35 human body joints from raw sensor data. Extensive experiments on a custom dataset demonstrate the effectiveness of the approach in terms of both accuracy and temporal stability. The results demonstrate its potential for real-world deployment in applications such as intelligent sports, rehabilitation, immersive digital human systems, and wearable human-computer interaction platforms.
AB - In recent years, significant progress in single-walled carbon nanotube (SWNT)-based flexible strain sensors has facilitated the development of low-cost, flexible, and wearable sensor networks for human motion sensing. However, due to the complex and nonlinear mapping between sensor outputs and human motion, accurately achieving digital human reconstruction from such sensor signals remains a challenging task. This paper proposes a spatiotemporal attention-based and physically constrained algorithm for digital human reconstruction using flexible sensor networks. An improved Transformer architecture is designed to model both temporal dynamics and spatial correlations among multiple sensors through a spatiotemporal attention mechanism. Furthermore, a composite loss function incorporating motion continuity and physical plausibility constraints is introduced to improve the smoothness and realism of predicted motion trajectories. The proposed method achieves real-time, end-to-end prediction of 35 human body joints from raw sensor data. Extensive experiments on a custom dataset demonstrate the effectiveness of the approach in terms of both accuracy and temporal stability. The results demonstrate its potential for real-world deployment in applications such as intelligent sports, rehabilitation, immersive digital human systems, and wearable human-computer interaction platforms.
UR - https://www.scopus.com/pages/publications/105018740032
U2 - 10.1109/AIM64088.2025.11175836
DO - 10.1109/AIM64088.2025.11175836
M3 - 会议稿件
AN - SCOPUS:105018740032
T3 - IEEE/ASME International Conference on Advanced Intelligent Mechatronics, AIM
BT - 2025 IEEE/ASME International Conference on Advanced Intelligent Mechatronics, AIM 2025
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 2025 IEEE/ASME International Conference on Advanced Intelligent Mechatronics, AIM 2025
Y2 - 14 July 2025 through 18 July 2025
ER -