'the overhead of profiling and applying optimizations has always been greater than any efficiency gains.'
Not necessarily, especially if you explicitly rely on them.
For example in C++ you deliberately have to avoid overusing virtual functions if you don't want the overhead. In Java, virtual functions are the default, and you usually don't care: if you call them a lot (e.g. in a tight loop) JVM will adaptively give you the proper implementation - without per call indirection - or may even inline it.
If you code C++ in Java style then JVM will win - so the overhead of (runtime) profiling and applying optimizations not always greater