Are you against speed limit enforcement too? Or is this a matter of degree and not pure principle?
We already have laws that make people responsible if they are speeding and crash and hurt someone, and people still do it. The problem with your logic of "there should be no rule unless someone does something to hurt someone" is that people are not always rational, and once someone is hurt or killed it is too late. It is better to try and discourage the behaviour that hurts someone before it happens, rather than after.