I had a business partner/family member steal money from me in our business. It very much hurt and was a painful experience hoping for vengence. Perhaps SBF being distant from you is what makes you indifferent.
I'm also pretty distant from a mugging that might happen today, but I find myself getting angry about it, so that also seems to contradict the theory that it's about distance (though to be clear, I largely agree with you and I suspect distance is going to be a factor for most or maybe the vast majority of people).