True, but a transformer system regresses to the mean. I don’t mind that with my bank’s app (in fact thats probably a good thing) but there are other kinds of applications where creativity will be required.

I really doubt we’ll have systems that come up with the Apple folding phone’s “blurry image of the outside screen as you open that snaps into focus as you finish opening it” feature, at least for a very long time. The very training system of these foundation models works against it.