Does this take into account the fact that you might need fewer epochs if you reduce the batch size? (as is done for the CPU?)
No, this is really only comparing the throughput on the devices. A thorough comparison should really focus on time to reach a certain quality - including all of the tricks available for a certain architecture.