The other day I was shopping for a camera lens, and instinctively I went to Amazon first, I found the lens but it was not shipped with Prime, so I went to look for it at B&H and Adorama. The difference to me is that if something says "Prime" then it's in stock and ready to ship, otherwise it will take over a week. B&H and Adorama both have their stuff in stock and are ready to ship the same or next day, so I know I'd receive it within 2-4 days.
Now compare that to the option between waiting almost a week for something from Amazon without prime or picking it up the same day from a local store as you had mentioned. Prime is definitely an incentive for me to even look at Amazon, let alone shop.