Is this a jvm specific problem? Scala seems to have huge build times too.
Another problem is compiler performance (both Kotlin and Scala compilers compile less statements per second than Javac), but it's not that dramatic.
Finally, dexing languages with runtime (kotlin - ~200KB, scala - more than 1MB) takes time.
Luckily, Buck optimizes most of it.