I wonder how much of the slowness is due to disk swapping since the RAM capacity is so low.
For comparison, my first Linux box (a 386SX, 20 mhz) had only 4 megs of RAM.
A barebones debian installation should be using < 50Mb at boot, so a custom gentoo could be <40Mb