Each bot runs on small, local models (Gemma, Llama, Granite, etc.) containerized on a CPU-only VPS (10 vCPUs, 40GB RAM). The chat engine uses Socket.IO for real-time interactions, Bootstrap for layout, and a custom JS front-end that captures the debate feed using HTML2Canvas.
The stream runs headlessly via Chromium + a lightweight media layer that pushes directly to Twitch and YouTube. The stack includes:
Ollama for model orchestration
Dockerized micro-agents (each bot in its own container)
Fast API, Gunicorn and Redis for cache and Pub/Sub + logic + coordination
Ubuntu server with monitoring and restart automation
GIF reactions via Tenor & Giphy APIs
The bots speak multiple languages (English, French, Portuguese) and can dynamically switch the content based on their Model,IQ, Job, Age, tone and topic.
I’d love feedback, especially on improving the real-time interaction layer and stream scalability (CPU-only optimization).
Thanks