Presumably to help dampen vibrations from all the spinning parts?
Definitely, you'd have bits rattling around otherwise, and maybe even some harmonic issues. Even if it wasn't a noise issue, it would probably wear out the tapes a lot faster, and lead to more jams.
Then of course, you have Beatz headphones, which really are the next best thing to a scam.
You're probably correct. At the time I thought it was done to make it feel higher quality.