Guys, I didn't get 4 available GPUs, so I am using 2, it says in the vid: New learning rate = (no.

Guys, I didn't get 4 available GPUs, so I am using 2, it says in the vid:

New learning rate = (no. of GPUs * batch size / 2) * LR

= (2 * 1/2)* 0.00005

= 0.00005

For me, the formula just cancels out. Wth? ๐Ÿคฃ
Was this page helpful?