Knowing a little more than non-technical employers doesn't place an inexperienced developer in a position of expertise, only knowing a little more than the guy testing them.
If you are referring to non technical folks not being skilled at hiring for technical positions, I agree to the point that this is a common challenge where non tech people are put in charge of digital transformation, among other things.
Even highly competent and technical teams can struggle with testing incoming hires we.
An interesting idea is contemplating if tech people will be able to learn and transform business skills easier than non techs business folks might be able to learn tech. If this was attractive to tech folks, the hiring tests would include more business problem oriented questions than fizzing and buzzing. It's still a little surprising how few developers can do this in any country, so it might remain an inconvenient test and filter for a while yet.