I have synthetic shorts [1] and collar shirts [2] that aren’t, and don’t look like, sports clothes. They are great, you can wash them in the shower at night and have them (mostly) dry by morning.

1: https://www.billabong.com/crossfire-mid-submersible-shorts-1...

2: https://www.target.com/p/men-39-s-jersey-polo-shirt-all-in-m...