bahaAbunojaim

When you say orchestrate agents then what it would do? Would it allow the same context across agents and can I make agents brainstorm?

It would be great if the community can run some benchmarks and post it on the repo, planning to do that sometime in Jan

This is one of the reasons I actually built it but wanted to make it more generalized to work with any agent and on the same context without switching

I can make it for the terminal if that would be helpful, what do you think?

I will check it out indeed. What is common between the two?

True and hearing feedback is always helpful and helps validate if it is a common problem or not

Would love to hear your feedback! Please let me know if I can make it any better or if there is anything that would make it very useful

That’s a great idea! I can make it a CLI too

We've developed a model router and a token optimizer exposed through a simple gateway compatible with OpenAI SDK. The model router would automatically route to the best model for the prompt and the token optimizer would optimize the tokens used in a thread to only the ones relevant to the query; essentially expanding the context window limit, reducing cost and increasing both inference and reliability. We would love your feedback as we continue to develop it.