You can do both. Preserving the corpus and building the LLM probably gives the best chance for future generations.