What I'm interested in is running Debian and X on the watch... any pointers?
But in all seriousness, getting Debian/X on this probably wouldn't be that hard after dmitry's work, probably just getting a basic working framebuffer driver, packing a modified Debian ramdisk and the kernel blob in an aboot image, and having the ramdisk bootstrap the rootfs on the NAND, start X with fbdev, and load MicroWM or something. That was basically what I did a while back trying to get Angstrom on a Chinese camera that ran Android and it worked okay...
That is to say that the work is all done for you. Enjoy :)