Chlorine in water is actually fine and tasteless at the concentrations it reaches at the taps - it's basically extremely diluted stomach acid.
The problem is chloramines caused by chlorinated organics. These give water the swimming pool smell and are bad for you.
The solution is easy - reduce the organics in the water before chlorination, and oxygenate (aerate) the water before delivery. But systems can get overwhelmed by too much rain and runoff.