You can also tell quite a bit based upon the citations. I've been able to guess at who was the original author based on how the paper was written/structured and the citations.
You can also guess who writes reviews. There was this one guy who got pissed off at me at a conference for nonchalantly discussing who I thought the reviewers on our paper were... whatever man, it's my review now.