That's not true, you can run a 30 years old binary on modern CPUs. The machine code you feed to the CPU didn't change much.
That's not true for GPUs, the machine code changes very frequently. You feed your "binary" (PTX, ...) to the driver, and the driver compiles it to the actual machine code of your actual GPU.