I was particularly excited for the high HumanEval score, and this is before the 400B model and the CodeLlama tune!

I just added Llama 3 70B to our coding copilot https://www.double.bot if anyone wants to try it for coding within their IDE