Eager-SGD is a decentralized asynchronous SGD. It utilizes novel partial collectives operations to accumulate the gradients across all the processes.
-
Updated
Nov 18, 2021 - Python
#
gradient-averaging
Here is 1 public repository matching this topic...
Add this topic to your repo
To associate your repository with the gradient-averaging topic, visit your repo's landing page and select "manage topics."