My team at my company alone burned through $100k worth of tokens in September.
When it hit $20k it triggered a talk with management, but ultimately they decided it was worth because of the value the LLM was providing.
When it hit $20k it triggered a talk with management, but ultimately they decided it was worth because of the value the LLM was providing.
This is something we've been trying to do for a while now and have not found a convincing metric.