What would it take to add animations?
As for a next step for the project, I'd like to keep track of the objects added to the scene, and draw them intelligently.
http://jdan.github.io/isomer/ (at the top)
I'm redrawing the entire structure each time, though. You could optimize it manually by only redrawing surrounding polygons. Performance seems pretty good on my end, decent on mobile.