Can Decentralized Algorithms Outperform Centralized ... - CUHK CSE

CNTK with MPI's AllReduce primitive; Centralized: Standard parameter-server based synchronous SGD and one parameter server; Decentralized: CNTK with ...
展开查看详情