bddppq··on Show HN: Running LLMs in one line of Python without Dockerlepton is at a different layer comparing to llama.cpp, in fact for LLM model files that are of GGUF format, it's using llama.cpp (ctransformers to be precise) as the execution engine
bddppq··on Show HN: Running LLMs in one line of Python without DockerAre there some examples(prompts) that Falcon 180B is performing better than Llama 70B?
bddppq··on Beating GPT-4 on HumanEval with a fine-tuned CodeLlama-34BThanks for pointing out. We have now updated the prompt template to follow the format.