Not looking good. Apparently the model was broken when they released it yesterday. The version they uploaded 8hrs ago only has an 8k context length, so we can't test it on the novels.

Here's the updates to the model config on huggingface:

https://huggingface.co/mattshumer/Reflection-Llama-3.1-70B/c...