I don't remember them saying "$100 billion models are all you need for AGI." Don't suppose you have a link?
See Situational Awareness for one example of this.
https://www.reddit.com/r/mlscaling/comments/12mktym/sam_altm...
This summer he made a comment saying "we can make GPTs 5,6,7 more powerful" and someone editorialized it as being "via parameter count/scale" which he didn't say.