Surprised this is the case because I use their Rust v8 bindings on an ARM laptop almost every day. Have you tried building it from source?
Someone is doing the builds here - been using them and seem ok: https://github.com/LukeChannings/deno-arm64
I want to say I followed these instructions for doing so recently:
https://gist.github.com/plembo/c4920016312f058209f5765cb9a3a...