Relevant; LLama.cpp implemented grammar-based sampling last month.
https://news.ycombinator.com/item?id=36819906 https://github.com/ggerganov/llama.cpp/pull/1773
19 karma · joined August 14, 2023
https://news.ycombinator.com/item?id=36819906 https://github.com/ggerganov/llama.cpp/pull/1773