More like - does the castle doctrine apply to defending yourself against someone not actually trying to enter your castle.
It would be like shooting someone for taking pictures of your house from the street.
I'm relatively certain law enforcement would have opinions about that.