Skip to main navigation Skip to search Skip to main content

Flexible Sensor Network-Based Digital Human Reconstruction Using Spatiotemporal Attention Mechanism and Physical Constraints

  • Quanxing Li
  • , Lanjing Wang
  • , Zicao Peng
  • , Yuanxin Lu
  • , Qingqing Wang
  • , Shuo Ding
  • , Haitao Yang
  • Northwestern Polytechnical University Xian
  • Xi'an Peihua University
  • Nanjing University of Aeronautics and Astronautics
  • Henan Institute of Flexible Electronics (HIFE)

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

In recent years, significant progress in single-walled carbon nanotube (SWNT)-based flexible strain sensors has facilitated the development of low-cost, flexible, and wearable sensor networks for human motion sensing. However, due to the complex and nonlinear mapping between sensor outputs and human motion, accurately achieving digital human reconstruction from such sensor signals remains a challenging task. This paper proposes a spatiotemporal attention-based and physically constrained algorithm for digital human reconstruction using flexible sensor networks. An improved Transformer architecture is designed to model both temporal dynamics and spatial correlations among multiple sensors through a spatiotemporal attention mechanism. Furthermore, a composite loss function incorporating motion continuity and physical plausibility constraints is introduced to improve the smoothness and realism of predicted motion trajectories. The proposed method achieves real-time, end-to-end prediction of 35 human body joints from raw sensor data. Extensive experiments on a custom dataset demonstrate the effectiveness of the approach in terms of both accuracy and temporal stability. The results demonstrate its potential for real-world deployment in applications such as intelligent sports, rehabilitation, immersive digital human systems, and wearable human-computer interaction platforms.

Original languageEnglish
Title of host publication2025 IEEE/ASME International Conference on Advanced Intelligent Mechatronics, AIM 2025
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9798331533427
DOIs
StatePublished - 2025
Event2025 IEEE/ASME International Conference on Advanced Intelligent Mechatronics, AIM 2025 - Hangzhou, China
Duration: 14 Jul 202518 Jul 2025

Publication series

NameIEEE/ASME International Conference on Advanced Intelligent Mechatronics, AIM
ISSN (Print)2159-6247
ISSN (Electronic)2159-6255

Conference

Conference2025 IEEE/ASME International Conference on Advanced Intelligent Mechatronics, AIM 2025
Country/TerritoryChina
CityHangzhou
Period14/07/2518/07/25

Fingerprint

Dive into the research topics of 'Flexible Sensor Network-Based Digital Human Reconstruction Using Spatiotemporal Attention Mechanism and Physical Constraints'. Together they form a unique fingerprint.

Cite this