Hacker News Reader

Do you inference NanoGPT with say a Flask app? I made a WebUI for tiny Llama, but it doesn't work for NanoChatGPt

Ha ha not sure yet, I have only done it from the command line. Still got a lot to learn. Building something like this will be good for that!