We started with a fairly tiny computer, similar to the Gumstix.
I had a development setup on the bench that was running on a mini-itx board. PG convinced us we needed to launch the second my prototype worked, so I literally designed a case around the bench setup and stuffed it into a backpack.
Justin now carries a 2 lb Sony VAIO that runs Windows XP. The technology is simple enough that anyone can use it, and soon they'll be able to.