Interesting, thank you.

> This code is in JS because it has to run in the browser, so it is not super fast.

Try profiling heap allocations in Chrome Debugger. In my experience especially array-allocation can slow down JS-code a lot.