Apple got aboard the Java hype train with early versions of Mac OS X, they added a bridge so that you could write Cocoa apps with it, so the calculator is presumably a case of them dogfooding it. It didn't catch on. The bridge stuff was dropped after a while, and then built in Java was dropped just before the Mac App Store was launched.
Yep. It felt pretty even back then, where you could choose either. Get it? Java and Cocoa...