This looks very cool and is a massive improvement. If only OpenAI would also publish what they are doing to make 32K work.