While you make very good points, I think as society we are quite quick at discounting unknown unknowns in this case. Science and diagnostic methods have advanced a lot, but it is not at all improbable that there is some kind of man-made factor that also caused an increase in incidence of autism (or any other modern chronic disease, such as ADHD like I am). Being an unknown unknown, we literally cannot know until x decades later we find out, "ah yes, we used this chemical everywhere that had a measurable developmental effect on newborn. Whoopsie". Yet everyone keeps saying that's nonsense, let alone insulting and insensitive to even suggest that's the case.
I am not saying there is proof for the contrary, mind you, just science and laymen should avoid the hubris of thinking we haven't made a mistake along the way. It would not be the first time. Radium in toothpaste, cigarettes for sore throat, cocaine in health tonics, DDT, teflon, and the other hundred teratogen chemicals we have given pregnant women over the decades.