A Classic Practice Use of Synchronous SGD And Asynchronous SGD from Google

Click to View

https://static.googleusercontent.com/media/research.google.com/en//archive/large_deep_networks_nips2012.pdf

More Information about Synchronous SGD

Click to View

http://arxiv.org/pdf/1106.5730

https://arxiv.org/pdf/1808.07576

https://arxiv.org/pdf/1805.09767

Further Information about FedAvg

Click to View

https://arxiv.org/pdf/1602.05629.pdf

https://ai.googleblog.com/2017/04/federated-learning-collaborative.html

https://federated.withgoogle.com/

https://arxiv.org/abs/1912.04977