In many cities in the US, there's Microcenter, where you can walk out with every part you need. We also still have smaller stores that can build clones for you/hand you the boxes, but they don't quite have the same variety of parts.
Of course, you have Newegg and other online stores.