In my experience (arthritis), specialists typically won't take direct appointments without a referral. They don't want to triage the 90%, and most offices are booked weeks-to-months in advance...
I can get into local dermatologists without problem. But an endocrinologist takes a referral (because there are so few, and they’re all fully booked).