Why are you assuming that this is intended to be performant, compared to code that properly segregates the CPU- and GPU-side? It seems clear to me that the latter will be a win.
In the end, people program for GPUs not because it's more fun (it's not!), but because they can get more performance out of it for their specific task.