A lot of providers won't accept medicare because what they pay out is significantly lower compared to private insurance. That's why Obama's "If you like your doctor, you get to keep your doctor." promise was such a big deal.
[0] https://www.kff.org/medicare/issue-brief/how-many-physicians...