Hacker News Reader

Well, more wondering how I go from having local models into a production app with the model available - I guess swap it with a cloud offering?

You can run the same model in production, using Docker Model Runner in Docker CE. This is assuming, the model works for your production use case :)