Nice! I want to see about using that in https://github.com/bytewax/stateful-chat to remove the OpenAI endpoint requirement.