The chirp doesn't go to infinite frequency. The last rotation of the two black holes happens in some finite time, a time scale that gets longer the larger the black holes are.