The evidence is from a study with N=40. Not 40,000. 40.
The evidence is from a study with N=40. Not 40,000. 40.
It's worth noting that, in the absence of pre-registration, one should should assume that the body of literature (and any systematic review or meta-analysis that relies on it) could be significantly influenced by the file drawer effect.
Anyway, I looked at a recent systematic review from those search results (https://pmc.ncbi.nlm.nih.gov/articles/PMC8622150/), and it found exactly one double-blind RCT (https://pmc.ncbi.nlm.nih.gov/articles/PMC5794882/) that seemed to support what the FDA is saying here. It had a fairly short duration (12 weeks) and a small cohort (48). I'm not medical expert but I do read medical literature as an amateur, and I'm pretty sure this is nowhere close to the standard of evidence for establishing safety and efficacy that the FDA used to demand. It feels like we may be reverting all the way back to the evidentiary standards that allowed crap like thalidomide onto the market.
https://www.bmj.com/content/363/bmj.k5094
Participants 92 aircraft passengers aged 18 and over were screened for participation. 23 agreed to be enrolled and were randomized.
Intervention Jumping from an aircraft (airplane or helicopter) with a parachute versus an empty backpack (unblinded).
Main outcome measures Composite of death or major traumatic injury (defined by an Injury Severity Score over 15) upon impact with the ground measured immediately after landing.
...
go read it to find out what happened. No, really.
"The participants who did ultimately enroll, agreed with the knowledge that the aircraft were stationary and on the ground."
Another favorite of mine along these lines is "Cigarette smoking: an underused tool in high-performance endurance training". (https://pmc.ncbi.nlm.nih.gov/articles/PMC3001541/) This one might actually be quite pertinent in this case, because the FDA's decision appears to rely heavily on exactly the kind of reasoning that this article satirizes.
There's an old joke about the lack of randomized controlled trials for parachutes. The joke is deployed when people complain about the lack of formal studies for things whose benefit is obvious.
Then somebody went ahead and did it, just to be funny. But you can't actually do a randomized controlled trial on parachutes, so you get a third layer of joke, about studies that don't actually prove anything.
The question has relatively simple answers and it's sometimes used in risk management discussions to explain threat models.
* who this applies to (some studies suggest genotype and autism subtype matter for getting positive outcomes)
* what the side effects are (12 week studies of <100 people are not enough to safely deploy this as a long-term treatment at scale)
* how this compares to behavioral treatment (ABA and sensory interventions have reliable positive outcomes as well)
I think there's a useful signal there, but we need to be cautious rolling things out at a national scale without bigger studies.
Do we understand the cause of autism or how this supposed cure works?