I would be willing to bet that this isn't true for trained classical musicians. I've been able to very accurately count seconds for 30+ years now and I don't seem to be getting any worse at it with age, at least not yet.
Drummers usually have better time-feel that other musicians...