Borscht with a T is the Yiddish pronunciation, unlike Russian which drops the T. It's a more common spelling in areas that historically had a larger Eastern European Jewish population (like the US, where the "borscht" spelling extended out from New York).