But if I buy a lottery ticket, there's theoretically a chance of winning, even though I never actually will. It would still be fraud if someone sold lottery tickets for a lottery that never was.

Tarot readers are selling a fake good. You can't really escape the ethical implications of that.