Ah, this is really interesting. I knew that far more work had gone into the code NumPy rides on (of course), but not really much more than that.
I rewrote my clojure code to use JBLAS (jblas.org) and found stunning improvements: https://gist.github.com/264a2756fc657140fdb8