I'm not sure why, but my Ubuntu image with unity always thinks it should run at 10fps. I had to hard set the frame rate in compizConfig at 60 fps to get it to run smoothly.

Putting it here because it took me quite a while to figure out why it was 3D accelerated but still so slow.