Great job! My current project involves a whole lot of SVG and I'm quite happy with the performance. I'm using the Snap svg library and some hard coded SVG. Perhaps d3.js is causing the dragging to slowdown? Have a look at SNAP.svg