An x86 Linux VM on an ARM Mac is roughly native speed because it can utilize Rosetta 2: https://docs.getutm.app/advanced/rosetta/
Looks like you need to install an arm distro and x86_64 binaries on top of it though. May be a lot of trouble in some cases.