It's more like the content of the speech matters. If you tell someone you're going to kill them, it becomes self defense if they kill you before that happens.