It's correct. You can visit Medina as a non-muslim. But some parts of the city is off limit to non-muslims. It's Mecca that's totally off limit to non-muslims.

https://www.inclined2travel.com/post/medina-non-muslim