Some credit cards come with a feature where you can generate (and revoke) multiple numbers that charge your account.

So you could generate a new one to use with a shady business, and then revoke the number after you are done with the business.