>If you're at my private property, am I free to kill you? It's the same thing
No, it's not even close to the same thing. I have the right to ask you to leave, regardless of whether you're on my private property. The difference is that if you're on my property, my request actually carries weight. Your being on my private property is a privilege that I can extend to you and later revoke. I cannot control what you say, but I can make your welcome at my property conditional upon what you say. And in general, you do not have a "moral right" to trespass[1].
I do not have the right to kill you, regardless of whether you're on my private property. They are not comparable ideas.
And yes, I think that in terms of fairness, a property owner generally has the right to ask anyone on her property to leave for just about any reason or no reason[2]. If you come to my house and start making dick jokes that I find distasteful, there is absolutely nothing wrong with me asking you to cut it out or leave. But I don't have the right to kill you.
[1] There are exceptions, of course, which is why I dislike talking about general moral rights. I'm sure you can craft some clever thought experiment that will trip up this general rule, which is one of the reasons I consider myself a utilitarian.
[2] see above