As someone who both lives in the mid-atlantic and regularly has to plan around the weather, I can assure you that you simply have a confirmation bias. Our forecasts are actually pretty good, even for ones 7 days out.
Where people tend to get thrown is micro-storms during the summer months. They are basically impossible to predict accurately, at best it's just known that a random assortment of towns in a given area will received heavy rain for a short time. Being able to read radar is the best way to deal with this, but it's very short term only (15min to 1 hr).