Running Llama2 on an M1 MacBook Pro Using PyXet

about.xethub.com

12 pointsskadamat2 comments

Nice! I want to see about using that in https://github.com/bytewax/stateful-chat to remove the OpenAI endpoint requirement.

Solid idea, I might have to try just that!