The difference between a crackpot and a prophet is their reason for believing what they do. And their thinking couldn't be more different.
It's easier to paint a prophet as a crackpot if everyone else is putting time and energy into finding fault with them. You can vilify anyone, especially those that look different.