It's a fun idea. I'm working on something similar for my personal site (a little interactive 3D sandbox with threejs and bullet physics).
People saying that it's not small or that it doesn't load fast enough are kind of missing the point... it's supposed to be a showcase of some skills this person has, not a tiny fast site.