There are alot more stuff that OpenJDK does not have. Try running it on ARM for example, it's like 4 times as slow, unusable.
http://openjdk.java.net/projects/aarch64-port/
Are you sure it's 4 times as slow? I'd be surprised if that is the case, but don't have the hardware to check.