Because that definition was grandfathered in such that it matched the previous definition of a second up to the previously specified precision. You've just moved the arbitrary part to the number 9,192,631,770. The same thing was done for the meter (defined such that the speed of light is precisely 299,792,458 m/s), ampere (current which produces 2 × 10−7 N/m of force between two parallel conductors). There's plans to do the same thing for the kilogram using Plank's constant, but for now we're stuck with the prototype kilogram whose mass unfortunately changes more than we'd like.
I could see making a case that Planck time is special enough for 440 vs 432 to matter, but it is so far off the scale of human hearing that its even integer points would form an effectively continuous scale when it comes to audio.