*Personally I think today's frontier models can be beat by training from scratch. Haven't proved this yet tho*
On specific tasks sure on "generic performance" whatever that means for you not really.
On specific tasks sure on "generic performance" whatever that means for you not really.
in the future, for general perf, I am optimistic that someone will figure out an alphazero like approach (ilya/silver/sutton/carmack seem to be working on something like this)