I think we can agree that most families aren't abusive towards their children. And that homeschool education can be as good if not better than public school education. I was homeschooled K-12 myself, and I now have a college degree in software.
I disagree with your risk assessment, though. Most kids who are abused are most likely to be abused by a parent, not a stranger. (source: https://www.nationalchildrensalliance.org/media-room/nationa...)
Homeschool requirements vary wildly by state, and even in states with more requirements like testing, kids slip through the cracks. I was never required to take a standardize test by either of the states I lived in (Washington and Oregon). I knew a homeschool girl my age (12) who could not read. Her 16 year old brother could read, but could barely do math. They had no learning disabilities, their mom just wanted the welfare paycheck for them and otherwise ignored them. She already had a 5 year old and a newborn as well to keep the gravy train coming.
I had very little access to mandated reporters, and again nothing enforced by law. Those I did have access to, like my annual visit to my doctor, my mother insisted in sitting in the exam room with me. The doctors made no effort to remove her (they asked me in front of her if I was comfortable with her staying. Of course I said yes, I would have been severely punished at home if I admitted I wanted her to leave.)
Safety rules are not made with the 99% of good people in mind, but to catch the 1% of bad actors. Homeschooling is attractive to good parents because they can improve the outcomes for their children. It is also attractive to bad, abusive parents because it removes children from any external oversight and support structures outside their abuser's control.