That is exactly how it was done during the 1960'ies: The duration of atomic seconds varied from year to year and it proved utterly unworkable for everybody.