Flight Control of a Canard Rotor/Wing VTOL Aircraft Based on Reinforcement Learning Under Transition Flight Mode

Yinong Zhang; Huimin Zhao; Dehai Zhu; Ban Wang; Jiangtao Huang; Zhenghong Gao

doi:10.1007/978-981-99-0479-2_184

Flight Control of a Canard Rotor/Wing VTOL Aircraft Based on Reinforcement Learning Under Transition Flight Mode

Yinong Zhang, Huimin Zhao, Dehai Zhu, Ban Wang, Jiangtao Huang, Zhenghong Gao

School of Aeronautics

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

Abstract

The vertical takeoff and landing (VTOL) aircraft has developed rapidly in recent years due to its excellent performance in terms of takeoff, landing and cruising. As a relatively complete concept of VTOL aircraft, the canard rotor/wing (CRW) aircraft has the advantages of high hovering efficiency and fast cruising speed. In this paper, the concept of reinforcement learning is introduced, and a neural network controller which does not distinguish the flight mode and does not depend on the model is designed. Firstly, the dynamic model of the studied CRW aircraft in transition flight mode is established. Then, a pitch angle neural network control strategy is designed for transition flight mode based on the deep deterministic policy gradient (DDPG) algorithm. Finally, the effectiveness of the proposed pitch angle control scheme based on reinforcement learning is verified by simulation tests.

Original language	English
Title of host publication	Proceedings of 2022 International Conference on Autonomous Unmanned Systems, ICAUS 2022
Editors	Wenxing Fu, Mancang Gu, Yifeng Niu
Publisher	Springer Science and Business Media Deutschland GmbH
Pages	1985-1994
Number of pages	10
ISBN (Print)	9789819904785
DOIs	https://doi.org/10.1007/978-981-99-0479-2_184
State	Published - 2023
Event	International Conference on Autonomous Unmanned Systems, ICAUS 2022 - Xi'an, China Duration: 23 Sep 2022 → 25 Sep 2022

Publication series

Name	Lecture Notes in Electrical Engineering
Volume	1010 LNEE
ISSN (Print)	1876-1100
ISSN (Electronic)	1876-1119

Conference

Conference	International Conference on Autonomous Unmanned Systems, ICAUS 2022
Country/Territory	China
City	Xi'an
Period	23/09/22 → 25/09/22

Keywords

Canard rotor/wing aircraft
Reinforcement learning control
Transition flight mode
VTOL

Access to Document

10.1007/978-981-99-0479-2_184

Cite this

Zhang, Y., Zhao, H., Zhu, D., Wang, B., Huang, J., & Gao, Z. (2023). Flight Control of a Canard Rotor/Wing VTOL Aircraft Based on Reinforcement Learning Under Transition Flight Mode. In W. Fu, M. Gu, & Y. Niu (Eds.), Proceedings of 2022 International Conference on Autonomous Unmanned Systems, ICAUS 2022 (pp. 1985-1994). (Lecture Notes in Electrical Engineering; Vol. 1010 LNEE). Springer Science and Business Media Deutschland GmbH. https://doi.org/10.1007/978-981-99-0479-2_184

Zhang, Yinong ; Zhao, Huimin ; Zhu, Dehai et al. / Flight Control of a Canard Rotor/Wing VTOL Aircraft Based on Reinforcement Learning Under Transition Flight Mode. Proceedings of 2022 International Conference on Autonomous Unmanned Systems, ICAUS 2022. editor / Wenxing Fu ; Mancang Gu ; Yifeng Niu. Springer Science and Business Media Deutschland GmbH, 2023. pp. 1985-1994 (Lecture Notes in Electrical Engineering).

@inproceedings{abcc312f965c480a8120aee47b4ea76e,

title = "Flight Control of a Canard Rotor/Wing VTOL Aircraft Based on Reinforcement Learning Under Transition Flight Mode",

abstract = "The vertical takeoff and landing (VTOL) aircraft has developed rapidly in recent years due to its excellent performance in terms of takeoff, landing and cruising. As a relatively complete concept of VTOL aircraft, the canard rotor/wing (CRW) aircraft has the advantages of high hovering efficiency and fast cruising speed. In this paper, the concept of reinforcement learning is introduced, and a neural network controller which does not distinguish the flight mode and does not depend on the model is designed. Firstly, the dynamic model of the studied CRW aircraft in transition flight mode is established. Then, a pitch angle neural network control strategy is designed for transition flight mode based on the deep deterministic policy gradient (DDPG) algorithm. Finally, the effectiveness of the proposed pitch angle control scheme based on reinforcement learning is verified by simulation tests.",

keywords = "Canard rotor/wing aircraft, Reinforcement learning control, Transition flight mode, VTOL",

author = "Yinong Zhang and Huimin Zhao and Dehai Zhu and Ban Wang and Jiangtao Huang and Zhenghong Gao",

note = "Publisher Copyright: {\textcopyright} 2023, Beijing HIWING Sci. and Tech. Info Inst.; International Conference on Autonomous Unmanned Systems, ICAUS 2022 ; Conference date: 23-09-2022 Through 25-09-2022",

year = "2023",

doi = "10.1007/978-981-99-0479-2_184",

language = "英语",

isbn = "9789819904785",

series = "Lecture Notes in Electrical Engineering",

publisher = "Springer Science and Business Media Deutschland GmbH",

pages = "1985--1994",

editor = "Wenxing Fu and Mancang Gu and Yifeng Niu",

booktitle = "Proceedings of 2022 International Conference on Autonomous Unmanned Systems, ICAUS 2022",

}

Zhang, Y, Zhao, H, Zhu, D, Wang, B, Huang, J & Gao, Z 2023, Flight Control of a Canard Rotor/Wing VTOL Aircraft Based on Reinforcement Learning Under Transition Flight Mode. in W Fu, M Gu & Y Niu (eds), Proceedings of 2022 International Conference on Autonomous Unmanned Systems, ICAUS 2022. Lecture Notes in Electrical Engineering, vol. 1010 LNEE, Springer Science and Business Media Deutschland GmbH, pp. 1985-1994, International Conference on Autonomous Unmanned Systems, ICAUS 2022, Xi'an, China, 23/09/22. https://doi.org/10.1007/978-981-99-0479-2_184

Flight Control of a Canard Rotor/Wing VTOL Aircraft Based on Reinforcement Learning Under Transition Flight Mode. / Zhang, Yinong; Zhao, Huimin; Zhu, Dehai et al.
Proceedings of 2022 International Conference on Autonomous Unmanned Systems, ICAUS 2022. ed. / Wenxing Fu; Mancang Gu; Yifeng Niu. Springer Science and Business Media Deutschland GmbH, 2023. p. 1985-1994 (Lecture Notes in Electrical Engineering; Vol. 1010 LNEE).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Flight Control of a Canard Rotor/Wing VTOL Aircraft Based on Reinforcement Learning Under Transition Flight Mode

AU - Zhang, Yinong

AU - Zhao, Huimin

AU - Zhu, Dehai

AU - Wang, Ban

AU - Huang, Jiangtao

AU - Gao, Zhenghong

PY - 2023

Y1 - 2023

N2 - The vertical takeoff and landing (VTOL) aircraft has developed rapidly in recent years due to its excellent performance in terms of takeoff, landing and cruising. As a relatively complete concept of VTOL aircraft, the canard rotor/wing (CRW) aircraft has the advantages of high hovering efficiency and fast cruising speed. In this paper, the concept of reinforcement learning is introduced, and a neural network controller which does not distinguish the flight mode and does not depend on the model is designed. Firstly, the dynamic model of the studied CRW aircraft in transition flight mode is established. Then, a pitch angle neural network control strategy is designed for transition flight mode based on the deep deterministic policy gradient (DDPG) algorithm. Finally, the effectiveness of the proposed pitch angle control scheme based on reinforcement learning is verified by simulation tests.

AB - The vertical takeoff and landing (VTOL) aircraft has developed rapidly in recent years due to its excellent performance in terms of takeoff, landing and cruising. As a relatively complete concept of VTOL aircraft, the canard rotor/wing (CRW) aircraft has the advantages of high hovering efficiency and fast cruising speed. In this paper, the concept of reinforcement learning is introduced, and a neural network controller which does not distinguish the flight mode and does not depend on the model is designed. Firstly, the dynamic model of the studied CRW aircraft in transition flight mode is established. Then, a pitch angle neural network control strategy is designed for transition flight mode based on the deep deterministic policy gradient (DDPG) algorithm. Finally, the effectiveness of the proposed pitch angle control scheme based on reinforcement learning is verified by simulation tests.

KW - Canard rotor/wing aircraft

KW - Reinforcement learning control

KW - Transition flight mode

KW - VTOL

UR - http://www.scopus.com/inward/record.url?scp=85151048645&partnerID=8YFLogxK

U2 - 10.1007/978-981-99-0479-2_184

DO - 10.1007/978-981-99-0479-2_184

M3 - 会议稿件

AN - SCOPUS:85151048645

SN - 9789819904785

T3 - Lecture Notes in Electrical Engineering

SP - 1985

EP - 1994

BT - Proceedings of 2022 International Conference on Autonomous Unmanned Systems, ICAUS 2022

A2 - Fu, Wenxing

A2 - Gu, Mancang

A2 - Niu, Yifeng

PB - Springer Science and Business Media Deutschland GmbH

T2 - International Conference on Autonomous Unmanned Systems, ICAUS 2022

Y2 - 23 September 2022 through 25 September 2022

ER -

Zhang Y, Zhao H, Zhu D, Wang B, Huang J, Gao Z. Flight Control of a Canard Rotor/Wing VTOL Aircraft Based on Reinforcement Learning Under Transition Flight Mode. In Fu W, Gu M, Niu Y, editors, Proceedings of 2022 International Conference on Autonomous Unmanned Systems, ICAUS 2022. Springer Science and Business Media Deutschland GmbH. 2023. p. 1985-1994. (Lecture Notes in Electrical Engineering). doi: 10.1007/978-981-99-0479-2_184