Is it more of an attack vector than the hundreds of unvettable third-party scripts the site usually loads itself?
Also, not all extensions run on every single site. Also, some extensions actually help in blocking malware, crypto-trackers etc so the potential upsides are also great.