"Laches" https://en.wikipedia.org/wiki/Laches_(equity) is probably a relevant concept here. In a scenario like the one you're describing, the delay is likely to be taken into account, but it's unlikely to be the whole of the argument.