Related discussion on serving finetuned LLMs: https://news.ycombinator.com/item?id=38196661