Shit, I have keratoconus with rigid lenses and been constantly rubbing my eyes for more than 10 years now. Been to two ophthalmologist and a couple opticians and no one ever mentioned that. Thanks for the warning!
I'll ask my ophthalmologist about scleral lenses or maybe hybrid or K-rose lenses as some other comments mentioned.