I find it socially acceptable. It's quite normal to jump from one tech company to another, and wearing a t-shirt from a previous employer is an artifact of that lifestyle.

My hot take: I've always interpreted it as "street cred" thing. Getting a job at Google is difficult, for example, and wearing a t-shirt from your Google days could show intellectual pride.