I think it's much easier to do if you're abandoning video games entirely, something that would make no sense for windows. The only reason I'd buy a non-amd64 PC is if it's better at running amd64 software than amd64 processors.
Having seen what box64 can do on my phone, I don't think it'd be that terrible. The graphics intensive system calls are all native system library code. The CPU parts will run slower, of course, but if they can beat the M3, I don't think the result would be all that bad.
ARM has tremendous efficiency benefits. I'd happily trade off top-line performance for 3x battery life and no fans