My PC is very electrically noisy on account of the GPU. This noise was coming out of all the ports, including the Ethernet port. It was making it through that port, by CAT-6 cable, to my switch. The switch then sent it to my Raspberry Pi I was using as a streamer, then into my DAC, amplifier and finally speakers. You could hear it, it was loud when a game started up.
The solution - swap out the CAT-6 with CAT-5 cable which doesn't connect the ground planes. Instantly solved.