Dang, so is Groq the cheapest for running Mixtral then? How capable is that model versus GPT 3.5 for basic tasks?
So I am going with Claude 3 Haiku. Hopefully Groq will be able to start charging soon and the load will be more tolerable to service without queues.