I've been buying EeePC 1001px machines on eBay for under $40 for some semi-embedded work. I put Xubuntu on them, and they get the job done. If they break, I'm out $40.
If you're going to build stuff for outdoor use, coat the electronics with a waterproof silicon conformal coat.[2] (Mask the connectors first.) This will prevent corrosion on the coated parts. Automotive and marine electronics usually get this treatment at the factory, but, annoyingly, mobile devices usually don't.
[1] http://www.ebay.com/itm/Panasonic-ToughBook-CF-30-MK3-Rugged...