Good idea, maybe I'll add Groq as another option, since I don't have an internal Llama 3.1 flow yet. But I'll still need to keep the others to maintain the diversity of responses.
possible to allow users of ithy the option to add their own API keys for N of your used services to offset your own $?