Sonic booms are very loud and disruptive. NASA has done some research into mitigation by using blunt-nosed aircraft, but none of that applies to Boom's more conventional design.

Here's what the Concorde sounded like at altitude, from the ground: https://www.youtube.com/watch?v=cbPh2llw0-M