This effect uses both WebGL and canvas 2d. I'd guess that for some reason the canvas 2d isn't using hardware acceleration on those browsers?
Somebody has made a version using WebGL alone[1] (sadly they got the refraction a bit wrong), try it to see if it works well enough (and let me know, I'm curious myself).