One weird trick for parallelizing convolutional neural networks

2014984 citationsPreprintgreen Open Access

Authors

Abstract

I present a new way to parallelize the training of convolutional neural networks across multiple GPUs. The method scales significantly better than all alternatives when applied to modern convolutional neural networks.

Topics & Keywords

Advanced Neural Network Applications Stochastic Gradient Optimization Techniques Neural Networks and Applications

Publication Details

Published in: arXiv (Cornell University)

DOI: 10.48550/arxiv.1404.5997

Command Palette

One weird trick for parallelizing convolutional neural networks

Authors

Abstract

Topics & Keywords

Publication Details