And remember, the tax advantage doesn't hold everywhere (certainly not in California anymore). Amazon has to offer something better other than price, and I think Prime is a large part of that.
As for "offer something better other than price", most people point to customer service, and in my experience Costco's customer service completely blows away Amazon.