Some GPUs have integrated memory with the CPU and don't need to do the transfer, it could still speed things up there couldn't it?

Also, they didn't ignore the key detail, they mention it: "This is without taking into account the overhead of transferring data to the GPU."