Dave Ramsey has encouraged millions of his followers to do the same ("indeterminable" score"). For the most part, it is not that much of a problem. Even home mortgages can done through manual underwriting.

The biggest pain point seems to be car rentals as they seem to have constantly shifting and strange rules about whether and when they accept debit cards. The next seems to be car insurance discounts as insurers seem to have strangely connected your driving risk with your credit score.