Not true. The VM is very important. The consistent & unified memory model is why Java can do synchronising, threading, garbage collection efficiently, cross platform and consistently.
Also, HotSpot is really important. Java is an acceptable systems language at 80-110% the efficiency of C. It's not at 50% or less.