At 100 bytes per sentence, you could fit 10000 example sentences in a megabyte, and compression would increase that by a factor of 6 or so. I don't think you need an on-device LLM to have enough example sentences.
If you don't know where to get that many sentences other than using an LLM, try Tatoeba https://tatoeba.org .