Had to deal with this before. Really hampered things with bloated backups and extended restore times during restoration tests.

Also not a good plan for the database to no longer fit within RAM, especially if the storage engine is evicting cached pages for blob content, only to populate a CDN.