No Improvement in Accuracy with higher batch size like 8 (Multi GPU)

Author: sree3333Created Apr 3, 2023Updated Mar 20, 2026

I m trying to training over a dataset of 7k image with a batch size of 8 and 3 GPU parallely but once I increase batch size from 4 to 8, accuracy takes a hit and it wont improve from the first epoch itself