Its more of a tech demo since its llama 7B (a model that is, TBH, obsoleted by mistral 7B), and its dataset is not that great.
We've had Yi 6B 200K context for some time, which is also quite good.
The problem, of course, is hardware requirements and vram. This one is particularly hairy since its not a GQA model.