I have downloaded complete plans that were created in 1972 to make an entire .22 caliber single shot pistol by hand using a hacksaw, file and drill press. By my estimation, it can be done in one long day of work by a semi-skilled person. An even simpler pistol can be built in an hour or two. It's just not hard to make a basic gun: when I was 11 years old I used to make toy "guns" from old hollow keys, crushed match heads and nails. They worked, but only had about a 10-foot or so range.
Granted, I planned to build the pistol using a (manual) milling machine, not by hand, but is the government going to outlaw saws and files now?
I, too, used to stuff firecrackers down a pipe and shoot steel balls (from bearings) when I was a kid - it was fun, what can I say :-)...
And it is only going to get cheaper - http://reprap.org/wiki/MetalicaRap
Manufacturing ammunition is simple and requires components and equipment that can be purchased for relatively little money and with (almost) no restrictions.
Buying gunpowder, primers, bullets, and casings is very possible via the internet (though gunpowder and primers are subject to hazardous shipping restrictions). After that, you could in principle make ammo using a 2x4 and a hammer if you really wanted to. A single-stage reloading press and the accoutrements can be obtained for under $200 trivially, and if you want to step up to relatively fast manufacture (hundreds of rounds per hour) you're still only talking a $500ish investment.
Some people do it to save money, some because they're competitive shooters (who want to hand-optimize their loads), and others are survivalist types who want to be "off-the-grid".