TSV files solve that problem nicely. Having worked extensively with TSV files, I'm not entirely sure why anyone would choose CSV over TSV, other than interfacing with something that only outputs CSV.
It doesn't solve the problem, as there can be tabs in the data just like there can be commas. Tabs may be less common but it's still fundamentally the same.