It would be ideal for them for LLM access portability to let them offer higher end models and have the end consumer pay directly for the usage.
Id much rather pay for one AI License, and a small fee to each service I use, rather than paying a high tier AI Bonus price at every single service.
Then there's the disparity in how many third party services each user uses. Some will use one, some will use 50. Google could charge per integration, but that's basically the status quo.
I get nervous plugging my pay-as-you-go API keys into random software because of the risk they rack up a $1000 bill doing something I wouldn’t have paid $20 for them to do.
The other three things are that economies of scale make it cheaper for Kagi to buy a bajillion tokens, Google et al don’t want to manage the customer side of things (what service ate how many tokens?), and service providers don’t want you seeing their “magic” in your console. Seems like there’s a lot of power in the system instruction side of things, and Perplexity probably doesn’t want you seeing their prompt.
Hearing from whom?