OctoPack: Instruction Tuning Code Large Language Models

Paper: https://arxiv.org/abs/2308.07124

Highlights: This paper demonstrates the instruct fine-tuning code for Language Model Models (LLMs) using public Github commit data. The proposed method achieves the highest HumanEval pass@1 accuracy among permissive licensed LLM models.