Skip to main navigation Skip to search Skip to main content

ReaLM: Real-Time Channel Prediction with Distilled LLM

  • Bo Wang
  • , Lin Li
  • , Decan Zhao
  • , Wensheng Lin
  • , Qinghe Du
  • , Lixin Li
  • Northwestern Polytechnical University Xian
  • Xi'an Jiaotong University

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

In the realm of next-generation wireless communications, real-time and accurate channel state information (CSI) prediction remains a major challenge due to the complex, dynamic, and noise-prone nature of wireless environments. To tackle these difficulties, we propose ReaLM, an efficient framework that adapts and compresses large language models for channel prediction tasks. We fine-tune the Llama model with a time-frequency data fusion feature extraction module, enabling more effective spatiotemporal sequence modeling of CSI. After training, we design a knowledge distillation strategy to reduce the high computational latency and heavy parameter load of large language models, compressing the model by 62% and accelerating inference by 58%. During training, we apply data augmentation and noise injection to improve the model's antiinterference capability. Extensive experiments demonstrate that ReaLM outperforms traditional baselines in low-SNR and crossenvironment scenarios, establishing itself as a robust and efficient solution for 6G real-time channel prediction.

Original languageEnglish
Title of host publication2026 IEEE Wireless Communications and Networking Conference, WCNC 2026
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9798331577292
DOIs
StatePublished - 2026
Event2026 IEEE Wireless Communications and Networking Conference, WCNC 2026 - Kuala Lumpur, Malaysia
Duration: 13 Apr 202616 Apr 2026

Publication series

NameIEEE Wireless Communications and Networking Conference, WCNC
ISSN (Print)1525-3511

Conference

Conference2026 IEEE Wireless Communications and Networking Conference, WCNC 2026
Country/TerritoryMalaysia
CityKuala Lumpur
Period13/04/2616/04/26

Keywords

  • 6G
  • Channel Prediction
  • Deep Learning
  • Distillation Learning
  • LLM

Fingerprint

Dive into the research topics of 'ReaLM: Real-Time Channel Prediction with Distilled LLM'. Together they form a unique fingerprint.

Cite this