Had there been a blanket ban on all Russian athletes, that would have been seen as a politically-motivated decision. It would have been interpreted by many third-party observers as Westerners using their clout to mess with a geopolitical foe.
Right now it's about a non-state actor (the Olympic committee) doing what amounts to disciplinary action within it's own ranks. From that point of view, it's purely administrative, and keeps politics out of it (to a degree).