跳到主要导航 跳到搜索 跳到主要内容

Research on RBM Networks Training Based on Improved Parallel Tempering Algorithm

  • Northwestern Polytechnical University Xian

科研成果: 期刊稿件 › 文章 › 同行评审

4 引用 (Scopus)

摘要

Currently, most algorithms for training restricted Boltzmann machines (RBMs) are based on multi-step Gibbs sampling. When the sampling algorithm is used to calculate gradient, the sampling gradient is an approximate value of the true gradient, and there is a big error between the sampling gradient and the true gradient, which seriously affects training effect of network. This article focuses on the problems mentioned above. Firstly, numerical error and direction error between gradient and true gradient sampling are analyzed, as well as their influences on the performance of network training. The problems are theoretically analyzed from the angle of Markov sampling. Then a gradient modification model is established to adjust the numerical value and direction of sampling gradient. Furthermore, improved tempering learning based algorithm is put forward, that is, GFPT (Gradient fixing parallel tempering) algorithm. Finally, a comparative experiment on the GFPT algorithm and existing algorithms is given. It demonstrated that GFPT algorithm can greatly reduce the sampling error between sampling gradient and true gradient, and improve RBM network training precision.

源语言英语
页(从-至)753-764
页数12
期刊Zidonghua Xuebao/Acta Automatica Sinica
卷43
期5
DOI
出版状态已出版 - 5月 2017

学术指纹

探究 'Research on RBM Networks Training Based on Improved Parallel Tempering Algorithm' 的科研主题。它们共同构成独一无二的学术指纹。

引用此