Now, for most hobbyist designs the rule of thumb is use a simple LDO and the recommended input/output caps (1-10uF) for it and use wide traces to route the power in a star like fashion. Also put a 100nF capacitor next to each power pin for noise and to serve as a power reserve.
More complicated circuits / circuits that will need to go through FCC will require more complicated power distributions. Most professional boards (with high frequency signals on it) that will meet FCC will be 4+ layers, with a dedicated ground and power planes. A PCB I just designed with an FPGA on it had something like 50 capacitors for just the 1 chip, with physical size requirements for each type (the smallest capacitors were 1mm x 0.5mm to block the highest frequency noise, anything bigger won't be as effective).
Don't let this deter you however, looking back on my first schematic/PCB designs I'm amazed at how much better I've gotten. Microcontroller designs with a few chips are very, very lenient. If you mess something up it will likely still work, but your performance won't be as good (i.e. if you use a built in ADC it may not be as accurate, or you might not be able to reliable run it at it's max clock speed)