The repo for training and finetuning this model is open source here: https://github.com/mosaicml/llm-foundry