There's a balance really. Don't overthink it, but don't just ignore the main issues. For example I unsubscribed from a few podcasts just because they had a lot of static, or completely unbalanced speakers' volumes. You don't need the latest and greatest software/hardware to deal with that, but do go with Audacity at least.
There's a very low threshold where whatever the content is, you can't concentrate on it. Do the minimum to not sound terrible at the beginning.