Say hypothetically you have a restraining order against you, and a company sends a piece of mail to your ex with your address as the return address and worded to look like it was from you. According to what you're saying, you'd be in the wrong because you didn't go through every company you've ever dealt with to tell them not to do that?
Because this is exactly what social media sites experiment with every day, they spoof their users or make it very confusing as to who exactly is sending correspondence and with email it's extremely easy to make it look like it came from the user when in fact they had no knowledge of this practice.
What are your thoughts on spammers spoofing you? Plenty phishing attempts happen this way, a spammer gets a hold of a mutual acquaintance's contact list, and sends email to one pretending to be another, without shades of grey you're saying that the spoofed individual should not be given some slack?