At what cost though? “Beating” isn’t enough if it costs 100x or even 10x the amount.

the bigger model would still cost more :) at the same time, i see prompting as being orthogonal to post-training. i'd imagine post-training a smaller model with a better prompt would make it perform even better