Yeah, I often have military flight training over my town, and I don't find the sonic booms particularly bad. I barely notice the planes unless they fly close to the ground over my house.
I'm not sure how the sonic booms of fighter jets compare to passenger planes, though.