摘要
As a cutting-edge disruptive technology, deep learning and unsupervised learning have attracted a significant research attention, and it has been widely acknowledged that training big data with a distributed deep learning algorithm can get better structures. However, there are two main problems with traditional distributed deep learning algorithms: the speed of training is slow and the accuracy of training is low. The Bootstrap aggregating-down stochastic gradient descent (Bagging-Down SGD) algorithm is proposed to solve the speed problem mainly. We add a speed controller to update the parameters of the single machine statistically, and to split model training and parameters updating to improve the training speed with the assurance of the same accuracy. It is to be proved in the experiment that the algorithm has the generality to learn the structures of different kinds of data.
投稿的翻译标题 | Distributed deep networks based on Bagging-Down SGD algorithm |
---|---|
源语言 | 繁体中文 |
页(从-至) | 1021-1027 |
页数 | 7 |
期刊 | Xi Tong Gong Cheng Yu Dian Zi Ji Shu/Systems Engineering and Electronics |
卷 | 41 |
期 | 5 |
DOI | |
出版状态 | 已出版 - 1 5月 2019 |
关键词
- Bootstrap aggregating-down stochastic gradient descent (Bagging-Down SGD)
- Deep network
- Distributed
- Speed controller