I used your Best 24GB settings and increased batch size to 2 while keeping everything else the same.
I used your Best 24GB settings and increased batch size to 2 while keeping everything else the same. To my surprise, this actually increased the total training time (it is very possible I screwed somethign else up). Are there any other settings you have to change to compensate for increased batch size? i.e. reduce num cpus per process?
