Depends a lot on the context behind that leaving. There are absolutely situations where it can be warranted - abuse (including verbal), for example. Politeness is the default state of affairs, but depending on how you behave, you might lose that privilege.