> This doesn't need to be a language feature, but this is possible on the JVM afaik (see Clojure).
You don't need Clojure; Hot Code Replacement was added in Java 1.4 (yes, that's 2002) and has been supported by application containers as well as IDEs since then.