There was an option to turn it off, at least it was there 4 years ago. You could make your visits invisible - but you were then unable to see who visited your profile. Seems fair to me.