You are correct with the credit card, they will most likely track you, but you have the option to use cash if you wish.
1. Not provide your email address 2. Pay in Cash 3. Don't give your home address
That is literally the only way you can't be tracked. But there are so many times you are prompted to provide that information:
* would you like a receipt to be sent to your email address? * would you like to sign up for our debit card and get $40 in savings? * would you like us to home deliver this free accessory which is unfortunately not in stock at this time?
You have to have Stallman level of rigor if you are serious about not being tracked.