Training neural networks faster without GPU [RB] (Ep. 77)

Join the discussion on our Discord server

Training neural networks faster usually involves the usage of powerful GPUs. In this episode I explain an interesting method from a group of researchers from Google Brain, who can train neural networks faster by squeezing the hardware to their needs and making the training pipeline more dense.

Enjoy the show!

  References

Faster Neural Network Training with Data Echoing https://arxiv.org/abs/1907.05550

Episode source