He left a void which is now being filled by Lex Friedman and others. Rogan doesn't even bother placing something about the podcast in title - he just names the guest which doesn't say anything to me so I dropped his show long time ago. Even went that far and send him an email regarding how frustrating it is to just listen to show after show until you find a subject that you like.
What he lost with YouTube is their algorithm which kept recommending bits and pieces aligned to what the user was already watching. With Spotify he's just there as an author/podcaster - nothing on the subject of what I am currently listening - he lost the context.
I placing his growth on YouTube and its recommendation engine more than anything else.