Ha! They already have a decade of my purchase history from being a Prime customer and I shop using an Amazon Credit Card. They've got everything they need and I don't mind.
Few people would be bothered by something like this. If they would be bothered, we'd see bigger noise about grocery store loyalty programs which are basically to track purchases.