You know what bothers me? So much of human ingenuity wasted on rather worthless tasks.
But my point is imagine if the person that did that simple TD lite model pre-training did something less... ad-related in his life.
What is the societal opportunity cost of a person not doing $this_thing_you_mentioned and applying it to just about anything else.