It’s not an exact figure, but plenty of employees claimed that after we train a model with 2-3 orders of magnitude of compute over GPT-4 we’d reach AGI, which puts us at $10-$100 billion.
See Situational Awareness for one example of this.
See Situational Awareness for one example of this.
https://www.reddit.com/r/mlscaling/comments/12mktym/sam_altm...
This summer he made a comment saying "we can make GPTs 5,6,7 more powerful" and someone editorialized it as being "via parameter count/scale" which he didn't say.