Germany actually has these restrictions because it affords its citizens more rights than most countries. And these restrictions exist exactly because rights may only be exercised unless they impinge on the rights of others.
And i invite you to read the very first law in the german body of law, that enshrines a right that does not exist in all countries:
https://www.gesetze-im-internet.de/englisch_gg/englisch_gg.h...