Hooray for containerized models, but a game changing feature for such containers could be K-V/prefix caching.

Previous discussion: https://news.ycombinator.com/item?id=40034972#40036309