I am not sure if you are being deliberately obtuse or simply unfamiliar with how ML is designed and implemented. Almost every single point you mentioned does happen in practice. Most are limited by budget and scale, just like real world experiments.