"To reproduce the results reported in the paper, you would need an NVIDIA DGX1 machine with 8 V100 GPUs."
That said, I'm not sure why one wouldn't get a similar result training on the EC2 or GCE instances that have 8 V100s. Or even training with fewer GPUs but accumulating gradients to get the same batch size.