Electronics - Newegg and Monoprice
Board & Table Top Games - Miniature Market
Pet Food - Chewy (owned by PetSmart now)
Clothing - Depends on your style, but I tend to stick to Eddie Bauer and Duluth Trading Company for good quality, affordable clothes
Comic trade paperbacks - InStockTrades
Books - Barnes & Noble (new) and eBay (used)
The big one I've still struggling to find a replacement for is shoes. Zappos seems to dominate that market and other online stores have been hit and miss. DSW has probably been the best, but I'd love to find something better.
For marketplaces/browsing, there are sites like ASOS, Gilt, Yahoo! Japan, eBay, etc. You can also browse any department store's online section to find something you like, and then order straight from the brand.
Probably more I can't think of.
I try not to participate in the Amazon empire too much, so far it's been a fine experience. I usually buy when I have a coupon or something goes on sale.
I just tried 5 different sub-$25 items. 2 day shipping was only offered on 3 of them, and varied between $7.99 and $11.44. One day shipping was offered on all of them, but was between $9.99 and $18.89.
There are some weird stacking effects on the 2 day shipping option as well - it's not a flat rate or per item rate, but falls somewhere in the middle. It's definitely more expensive the more items you have though.