Abstract
The depth control problem of autonomous underwater vehicle (AUV) by using deep reinforcement learning method was mainly studied. Different from the traditional control algorithm, the deep reinforcement learning method allows the AUV to learn the control law independently, avoiding the artificial establishment of accurate model and design control law. The deep deterministic policy gradient method was used to design two neural networks: actor and critic. Actor neural network enabled agents to make corresponding control actions. Critic neural network was used to estimate the action-value function in reinforcement learning. The AUV depth control was conducted by training of actor and critic neural networks. The effectiveness of the algorithm was proved by simulation on OpenAI Gym.
Translated title of the contribution | Depth control of autonomous underwater vehicle using deep reinforcement learning |
---|---|
Original language | Chinese (Traditional) |
Pages (from-to) | 354-360 |
Number of pages | 7 |
Journal | Chinese Journal of Intelligent Science and Technology |
Volume | 2 |
Issue number | 4 |
DOIs | |
State | Published - Dec 2020 |