You're confusing vacations with immigration. If that "guest" has come to your house on the premise that they're going to live with you, and you kick them out, yes, that is bad.
We even have laws about this, that's why there's a whole eviction process and it applies to people living with you as much as to normal tenants.