As a user I am actually okay with this. That way if I haven't visited a website in a long time, then most likely they should no longer have access to my account.
Maybe I've long moved on and forgotten about that one site that I authorised and now they are using my data in a way that I wouldn't approve of.