The ISA front-end is not strongly coupled and the original zen had a canceled version that used aarch64.
Some arm CPUs did have a mode that ran Java bytecode natively but it was slower than the jvm.
J2ME code for Jazelle based feature phones (with appropriate VMs) was noticeably faster than otherwise, to the point Android raw Java performance did not catch up for a really long time. If you have loads of RAM to JIT later then . . . good, but that didn’t arrive for years after the fact.