Go for it, wear some wrist protectors and you should arrive in one piece. That is the only protection I use given that it actually work as intended and broken wrists are fairly common in all forms of skating.
Also wear a helmet.
It's been over 20 years since I was on rollerblades and I don't even know if I'd have the balance anymore, but I wouldn't do it without at least one knee guard and both hard wrist guards.
Yes, if you're young and have good reflexes, you can break your wrists. If you're old with slower reflexes, you can't get your arms out in time so you break your hip instead.