一种基于Dyna-Q学习的旋翼无人机视觉伺服智能控制方法

Translated title of the contribution: A visual servo intelligent control method for rotor UAV based on Dyna-Q learning

Hao Bin Shi, Meng Xu, Jia Yu Liu, Ji Chao Li

Research output: Contribution to journalArticlepeer-review

1 Scopus citations

Abstract

The image-based visual servo control method of robots obtains the image information through the robot's vision and then forms the closed-loop feedback based on the image information to control the robot's reasonable movement. However, due to the problem of poor robustness and slow convergence, the selection of servo gain for classical visual servoing is artificial assignment under most conditions. Therefore, an intelligent servo control method based on Dyna-Q learning is proposed to adjust the servo gain to improve its adaptability. Firstly, this method uses the image feature extraction algorithm based on Felman chain code to extract the target feature point, then uses the image-based visual servoing to form the closed-loop control of the characteristic error. Then, this paper presents a decoupling visual servoing control model for the dynamic characteristics of rotor UAV's strong coupling underactuated. Finally, a reinforcement learning model using Dyna-Q learning to adjust the servo gain is established, through which the rotor UAV can choose the servo gain independently. The Dyna-Q learning method learns to store experience on the basis of classical Q-Learning by setting up an environment model, and the virtual samples generated by the environment model can be used as learning samples to iterate the value function. The experimental results show that the proposed method is faster and more stable than the classical PID control and classical image based visual servo methods.

Translated title of the contributionA visual servo intelligent control method for rotor UAV based on Dyna-Q learning
Original languageChinese (Traditional)
Pages (from-to)2517-2526
Number of pages10
JournalKongzhi yu Juece/Control and Decision
Volume34
Issue number12
DOIs
StatePublished - 1 Dec 2019

Fingerprint

Dive into the research topics of 'A visual servo intelligent control method for rotor UAV based on Dyna-Q learning'. Together they form a unique fingerprint.

Cite this