For me, it is the burden of having to create accounts for stuff I'll probably only use once, plus the mental burden of knowing that the website has my personal information and might leak it.
That, and the fact that having an account/app these days is synonymous with "oh, sure, send me all the spam you have!", via e-mail or mobile notifications.
If anything, password managers help me see which accounts I should be deleting.