The "public" is private anyway, as the Krankenkassen are all private companies (although strictly regulated by BMG).
But yes, there's concept of public (statutory) and private (voluntary) insurance plans.
On top of that, as you said, most (all?) Arztpraxen are also private entities. Same goes for hospitals (I guess excluding places like universities and Bundeswehr).