Interesting question.
I agree that video calls are a special hell.
I think I am reasonably high functioning in in-person settings, but I suspect I don’t read body language very well. I find eye contact difficult to maintain for reasons I do not know.
On the phone, I feel like conversations can be slower and more deliberate. I feel a freedom in not having to control my expressions and show my interest. I can just focus entirely on their voice, and I feel I have become very adept at this. I love podcasts and audiobooks and such, maybe there is a connection.
My wife describes very differently dynamics. She wants to meet with folks in person to “read” them better. She thinks my preference for phone only makes no sense.