There's a nuance here: a lot of times, it's people hearing "male privilege is a problem" and immediately being told that this means "you personally are at fault!" So it's very understandable that people believe that they're being told "everything is their fault because they have male privilege" when they're not.