You don't need an ARM runner to produce ARM images. Docker buildx supports building for more than one architecture through qemu: https://github.com/microsoft/azure-pipelines-tasks/issues/12...
Ryzen 9590X: 20:09 (20 min 9 sec)
Raspberry Pi 3: 15:46
Raspberry Pi 4 8GB: 4:34
That settled it for me.