TY - JOUR
T1 - FLIGHT CONTROL SYSTEM KNOWLEDGE GRAPH CONSTRUCTION BASED ON AERONAUTICAL DOMAIN KNOWLEDGE AUGMENTED LARGE LANGUAGE MODEL
AU - Fan, Yi
AU - Sun, Yu
AU - Mi, Baigang
N1 - Publisher Copyright:
© 2024, International Council of the Aeronautical Sciences. All rights reserved.
PY - 2024
Y1 - 2024
N2 - In the complex competitive aerospace environment, the continuous intelligent assurance of the Flight Control System (FCS) is essential for the successful execution of aerospace missions. Monitoring and maintaining the FCS under dynamic and complex conditions rely heavily on empirical expert knowledge. Domain Knowledge Graphs (KG) serve as an efficient mechanism for FCS status management within expert systems, enabling effective value extraction. This paper outlines the construction of an FCS KG through large language model (LLM) fine-tuning, enriched with aeronautical domain knowledge derived from multi-source heterogeneous FCS texts. The process begins with the creation of an FCS ontology, integrating aeronautical domain knowledge and defining entity-relationship types. Subsequently, the Llama3-8B LLM was fine-tuned using methods such as LoRA, QLoRA, and AdaLoRA for parameter-efficient tuning, and prior aeronautical knowledge was incorporated via a chain of thought (COT) prompt template to facilitate intelligent discovery from a common FCS dataset. Experimental results indicate that the aeronautical domain knowledgeaugmented LLM method achieved an F1 score of 97.86%, representing a 6.48% improvement over traditional methods. Finally, the FCS KG was visualized using the graph database Neo4j, demonstrating the effectiveness and superiority of this approach in constructing FCS KG.
AB - In the complex competitive aerospace environment, the continuous intelligent assurance of the Flight Control System (FCS) is essential for the successful execution of aerospace missions. Monitoring and maintaining the FCS under dynamic and complex conditions rely heavily on empirical expert knowledge. Domain Knowledge Graphs (KG) serve as an efficient mechanism for FCS status management within expert systems, enabling effective value extraction. This paper outlines the construction of an FCS KG through large language model (LLM) fine-tuning, enriched with aeronautical domain knowledge derived from multi-source heterogeneous FCS texts. The process begins with the creation of an FCS ontology, integrating aeronautical domain knowledge and defining entity-relationship types. Subsequently, the Llama3-8B LLM was fine-tuned using methods such as LoRA, QLoRA, and AdaLoRA for parameter-efficient tuning, and prior aeronautical knowledge was incorporated via a chain of thought (COT) prompt template to facilitate intelligent discovery from a common FCS dataset. Experimental results indicate that the aeronautical domain knowledgeaugmented LLM method achieved an F1 score of 97.86%, representing a 6.48% improvement over traditional methods. Finally, the FCS KG was visualized using the graph database Neo4j, demonstrating the effectiveness and superiority of this approach in constructing FCS KG.
KW - Flight control system (FCS), Knowledge graph (KG)
KW - knowledge discovery (KD)
KW - Large language model (LLM)
KW - Parameter-efficient fine-tuning (PEFT)
UR - http://www.scopus.com/inward/record.url?scp=85208787293&partnerID=8YFLogxK
M3 - 会议文章
AN - SCOPUS:85208787293
SN - 1025-9090
JO - ICAS Proceedings
JF - ICAS Proceedings
T2 - 34th Congress of the International Council of the Aeronautical Sciences, ICAS 2024
Y2 - 9 September 2024 through 13 September 2024
ER -