基于Bagging-Down SGD算法的分布式深度网络

Chao Qin, Xiaoguang Gao, Daqing Chen

科研成果: 期刊稿件文章同行评审

2 引用 (Scopus)

摘要

As a cutting-edge disruptive technology, deep learning and unsupervised learning have attracted a significant research attention, and it has been widely acknowledged that training big data with a distributed deep learning algorithm can get better structures. However, there are two main problems with traditional distributed deep learning algorithms: the speed of training is slow and the accuracy of training is low. The Bootstrap aggregating-down stochastic gradient descent (Bagging-Down SGD) algorithm is proposed to solve the speed problem mainly. We add a speed controller to update the parameters of the single machine statistically, and to split model training and parameters updating to improve the training speed with the assurance of the same accuracy. It is to be proved in the experiment that the algorithm has the generality to learn the structures of different kinds of data.

投稿的翻译标题Distributed deep networks based on Bagging-Down SGD algorithm
源语言繁体中文
页(从-至)1021-1027
页数7
期刊Xi Tong Gong Cheng Yu Dian Zi Ji Shu/Systems Engineering and Electronics
41
5
DOI
出版状态已出版 - 1 5月 2019

关键词

  • Bootstrap aggregating-down stochastic gradient descent (Bagging-Down SGD)
  • Deep network
  • Distributed
  • Speed controller

指纹

探究 '基于Bagging-Down SGD算法的分布式深度网络' 的科研主题。它们共同构成独一无二的指纹。

引用此