It feels to me like there's also quite a bit of temporal coherence that could be leveraged in order to accelerate the process.
It is a very nice idea though.
It seems to be based on numeric.js, which is based on the classic Fortran UNCMIN [1] optimizer.