Except it's not really.
Releases are always additive, and (to my knowledge) have never removed anything (even when they really really should have).
The only reason to target a newer version is if you need things that were actually added to the OS (like fingerprint scanning). And even there it's pretty easy to gate functionality. The vast majority of apps don't need to care in the slightest and with appcompat almost everything useful is available.
It's not like you have to make completely separate apps for Lollipop and Marshmallow the way you used to for IE and everything else.