Nice work on the scheduler. Have you benchmarked
parallel inference across multiple models?
Running GPT, Claude and Gemini simultaneously
on the same input is where latency becomes
a real constraint.
Even with just open-source LLMs, you can see interesting differences in flagged issues when cross-validating outputs.