My experience is very anecdotal, but I once heard about a teacher at a Japanese middle school that was like that. He got all his work done and was good at his job, but did typical 8-hour-days and left at 5.

The person telling me about him said while nobody showed any outward hostility towards him, he was kind ignored when it came to camaraderie between the staff, and perhaps even ostracized in a way. He seemed okay with not being too close with his coworkers though.

At the same time, I wasn't really there, so there could be more to it.