Very good result, and awesome to see such great progress happen so fast.

Quantizing/pruning/deduplicating/compressing models and embeddings is still a vast orchard of low hanging fruit.

I personally think there are still quite a few multiple-orders-of-magnitude scale opportunities to accelerate inference, and we are fortunate to have strong economic incentives aligned with the problem.