I also knew plenty of people in my previous career that came from tech, and seemed to have no trouble transitioning (but that was post-dotcom). It may be "hard to do so" now because increasingly the white collar job market is getting tighter which means people aren't looking to hire non-traditional candidates since they can usually find an equivalent candidate with more experience.
As other have mentioned, I think for most people the "hard" part is the change in income. Even with the decline in the tech space, tech workers still tend to get paid notably above other industries.
I think the real question boils down to: why are you transitioning? If you're sick of tech, or can't find a job it's going to be harder. If you're passionately obsessed with a new career and can't sleep at night without being compelled to study that area, you'll probably do fine. It also, of course, depends on the market for that job. If you're interested in a space that niche and packed with people then it will be hard, if you're interested in a new booming industry then it will be easier.