> Scale beats all else. The best performance improvements come from increasing scale, rather than incremental insights in novel architectures.
...until the next novel architecture is discovered, which won't happen without said AI research.
...until the next novel architecture is discovered, which won't happen without said AI research.