What you see as annoying, I see as a strength. You shouldn't break links; they don't only exist in your site. People will have them bookmarked or shared on the web.
There's nothing worse than finding a post online that seems like it will cover your exact issue, but the link is now a 404.