That’s not what the manufacturers of modern glass fiber insulation would have you believe. Plenty of people cutting and handling it with no PPE at all in their promotional literature.
https://www.owenscorning.com/en-us/insulation/pink-next-gen-...
https://www.owenscorning.com/en-us/insulation/pink-next-gen-...
Sure it's not good for you, so using PPE is certainly warranted, but it's on a whole different level of badness compared to asbestos.
[1] Per wikipedia, there are some varieties of mineral wool used for high temperatures (think insulating industrial furnaces and such) which are carcinogens.