- Trying to figure out how the heck to enroll people (vanguard study)
- Decide which variables are worth tracking, and actually trackable. Every variable they track will cost a tonne, if they don't track a variable and decide they need later it's too late.
- Figure out how long they will successfully be able to track people, will they lose 5% a year? 10%? Is there a huge cliff when kids turn 12 where they all move? WHO KNOWS?
- Actually enrolling people and tracking the variables that seemed worthwhile
- Revising surveys based on stuff they're learning.
It was to be a huge study, to be honest if completed I think it would have been the landmark medical advancements of our time.
(I briefly worked on one small piece of software supporting one small aspect of the study)
Now it sounds to me like when a corporation or large federal agency fails in implementing a new or upgraded software system because the process has become unmanageable. From your perspective in both worlds (setting aside the results published so far) does that analogy capture it?
It would be more like...if you rolled out an upgraded software system in a couple departments, collected some feedback, and decided not to go with the company wide rollout.
To use the space program analogy I advanced before, it would be like running Gemini and Mercury, then deciding to scrap the Apollo program because things weren't working out. A lot of science was done just laying the groundwork.