Hacker News Reader

Here's one I've used:

* https://www.together.ai/

Here are all the models:

* https://docs.together.ai/docs/chat-models

* https://docs.together.ai/docs/language-and-code-models

https://openrouter.ai is exactly that, and they even support payments with crypto.

>and they even support payments with crypto.

What a value proposition! ;-)

The true meaning of BlockchAIn.

Coinbase commerce? That's hardly crypto and I am not sure if it's better or worse than traditional payments.

Such services already exists. I don't want to promote any in particular, but if you do a research on pay-as-you-go inference of e.g. mixtral or llama3 you will find offerings that offer an API and charge just cents for XY amount of tokens, exactly as OpenAI does.

I addition to those mentioned by others, there is featherless.ai

You can use HuggingFace, PerplexityAI, Anyscale, TogetherAI. There are a bunch of options. Many offer OpenAI compatible APIs too.

I believe openrouter.ai has a few.

or crowd run, like through petals or kobald's ai horde.