I used to listen a lot 10-13 years ago, but whenever I listen now to a podcast, I find the information density really low. There's just a lot of social blabber about nothing. Though me and my gf listen a lot to lectures (TTC, etc.), audiobooks, etc. I find more polished content, much more enjoyable, than off the cuff talk.

It may have to do with patience and free time. :) A lot of the time podcasts take a lot of time to get to some point, and it's often times something that I already know from other channels that are easier to consume, like tweets, or whatever.