I think it's a fear thing. Do you wanna be the dev who introduces a bug to the /boot cleanup code and accidentally nukes all the kernels?
apt-get autoremove
It's just not enabled by default, you have to put it in /etc/cron.monthly, if you want it to just run for you.