Is it legal for a domain registrar to force me to renew a domain?

I bought a domain which I used for a a year and after expiry I decided to let it expire because I didn't have any use. 4 years later I bought another domain from the same registrar and when it expired I decided to renew but the registrar is insisting that I pay for both the domain that expired 4 years ago and the one which expired recently.