I say this as someone currently writing a native desktop app and someone who doesn't like Android (having shipped substantial Android and iOS apps):
Android apps are not incredibly slow compared to native apps, and the ones that are aren't due to Java. Android has always _used_ the JVM, just not run binaries _on_ the VM – they created their own (Dalvik) because they couldn't ship a Java virtual machine, so they shipped a virtual machine and played bytecode games so the thing that ran wasn't Java bytecode, and it wasn't run on a Java-compatible VM.
Also, Android has and will be running on the JVM, because they're transitioning to OpenJDK.