HNHacker News
TopNewBestAskShowJobs

santiago-pl

101 karma · joined January 28, 2026

GoModel is an open-source AI Gateway in Go and I'm the primary maintainer of this project.

Links: GoModel: https://gomodel.enterpilot.io GitHub: https://github.com/SantiagoDePolonia

submissionscomments
santiago-pl··on Show HN: GoModel – an open-source AI gateway in Go
That's great news! The AI model ecosystem is changing so fast.
santiago-pl··on Show HN: GoModel – an open-source AI gateway in Go
TBH I decided to write GoModel because I needed something like this for my startup, enterpilot, and LiteLLM didn’t meet my needs.
santiago-pl··on Show HN: GoModel – an open-source AI gateway in Go
I'll consider it for sure.
santiago-pl··on Show HN: GoModel – an open-source AI gateway in Go
It's like fuel costs in a supply chain. When you buy apples at the store, you don't think about oil prices. But if trucks ran on something cheaper, more efficient, or less taxed, the apples on the shelf would be cheaper too.
santiago-pl··on Show HN: GoModel – an open-source AI gateway in Go
"... and I don't see if I would be able to track usage from individual end-users through a header".

Currently we have a unified concept of User-Paths. Once you add a specific header OR assign User-Path to an API key, you can track the usage based on this. The User-Path might be youe end-user, internal user or some service. Examples:

  /client1/app1
  /agents/agent1
  /team2/john
  /team2/adam
Would this work for you?

https://gomodel.enterpilot.io/docs/features/user-path

PS Thanks for the feedback on the Vault integration. Noted.

santiago-pl··on Show HN: GoModel – an open-source AI gateway in Go
The LiteLLM SDK is intentionally on the website. You can "talk" to GoModel with it because both projects use an OpenAI-compatible API under the hood.

You can use it like this:

  from litellm import completion
  print(completion(
      model="openai/gpt-4.1-nano",
      api_base="http://localhost:8080/v1",
      api_key="your-gomodel-key",
      messages=[{"role": "user", "content": "hi"}],
  ).choices[0].message.content)
santiago-pl··on Show HN: GoModel – an open-source AI gateway in Go
Yes, the number of meaningful providers might be around 20-30.
santiago-pl··on Show HN: GoModel – an open-source AI gateway in Go
First, GoModel is designed to be flexible. If you add an extra field, it tries to pass it through in the appropriate place (Postel's law)

Therefore there's a good chance that if they make a minor API-level change, GoModel will handle it without any code changes.

Also, changes to providers' API formats might be less and less frequent. Keeping up typically means adding a few lines of code per month. I'm usually aware of those changes because I use LLMs daily and follow the news in a few places.

As a fallback, GoModel includes a passthrough API that forwards your request to the provider in its original format. That might be useful when an AI provider changes their contract significantly and we haven't caught up yet.

Also, official SDKs aren't bug-free either. Skipping that extra layer and hitting the API directly might actually be beneficial for GoModel.

santiago-pl··on Show HN: GoModel – an open-source AI gateway in Go
I'll take a closer look at it over the next few days.

However, it might be challenging, considering that Claude Code with a subscription no longer officially works with OpenClaw.

santiago-pl··on Show HN: GoModel – an open-source AI gateway in Go
Thanks for raising it! Since vLLM has an OpenAI-compatible API, this should work for now:

  docker run --rm -p 8080:8080 \
    -e OPENAI_API_KEY="some-vllm-key-if-needed" \
    -e OPENAI_BASE_URL="http://host.docker.internal:11434/v1" \
    ...
    enterpilot/gomodel
I'll add a more convenient way to configure it in the coming days.
santiago-pl··on Show HN: GoModel – an open-source AI gateway in Go
1. Yes, we have OpenAI-compatible API and we develop GoModel with Postel’s law in mind: https://gomodel.enterpilot.io/docs/about/technical-philosoph... .

2. Regarding being open-source and the license, I've described our approach here transparently: https://gomodel.enterpilot.io/docs/about/license

santiago-pl··on Show HN: GoModel – an open-source AI gateway in Go; 44x lighter than LiteLLM
You are not the first person who has asked about it.

It looks like a useful feature to have. Therefore, I'll dig into this topic more broadly over the next few days and let you know here whether, and possibly when, we plan to add it.

santiago-pl··on Show HN: GoModel – an open-source AI gateway in Go; 44x lighter than LiteLLM
This comment looks like AI-generated.

However IIUC what you're asking for - it's already in the dashboard! Check the Usage page.

santiago-pl··on Show HN: GoModel – an open-source AI gateway in Go
I would love to keep it open source forever, but I can't promise that for now. I've written a whole doc page about it if you're curious: https://gomodel.enterpilot.io/docs/about/license
santiago-pl··on Show HN: GoModel – an open-source AI gateway in Go; 44x lighter than LiteLLM
Agree and thank you! Please let us know if you'd like to give it a try and if you miss any feature in GoModel.
santiago-pl··on Show HN: GoModel – an open-source AI gateway in Go
First of all, GoModel doesn't have a separate private repository behind a paywall/license.

It's more lightweight and simpler. The Bifrost docker image looks 4x larger, at least for now.

IMO GoModel is more convenient for debugging and for seeing how your request flows through different layers of AI Gateways in the Audit Logs.

santiago-pl··on Copilot edited an ad into my PR
It reminds me of Anthropic's Super Bowl ad: “Can I get a six pack quickly?” It actually turned out to be true.
santiago-pl··on Show HN: Minimalist library to generate SVG views of scientific data
I like how the plots look!

In recent months, I’ve been making charts for the benchmarks just by talking to Claude Code or Codex: “Generate the charts for this and that.”

I could try pointing it to your project next time. It would be easier to do with some kind of easy-to-install skills for AI agents.

I think it’s an inevitable trend this year, something people call "building for agents." (I saw someone phrase it that way on X.)

santiago-pl··on Tell HN: Litellm 1.82.7 and 1.82.8 on PyPI are compromised
It looks like Trivy was compromised at least five days ago. https://www.wiz.io/blog/trivy-compromised-teampcp-supply-cha...
santiago-pl··on UK government publishes guidance on AI coding assistants
It's always interesting to read how the government is introducing AI into its work.

"The programmer is responsible for code produced" - that is definitely worth putting into practice.

"Providing more context to AI models can dramatically improve their performance. (...)" — on the other hand, too much context might reduce their performance.

santiago-pl··on Starlink militarization and its impact on global strategic stability (2023)
Si vis pacem, para bellum.

Just because I have a knife doesn't mean it affects the stability of my neighborhood. Even if I use my knife to kill a killer, that doesn't necessarily affect the stability of my neighborhood. It could even improve it.

All in all, I would rather live in a somewhat free America than in communist China.

santiago-pl··on First Website (1992)
It reminds me of a fun fact: HTTP/0.9 websites are the fastest because they were created years ago and have simple content.
santiago-pl··on Show HN: LLM Gateway for OpenAI/Anthropic Written in Golang
Hey Nathan,

I’m also working on the best AI gateway written in Golang :) https://github.com/ENTERPILOT/GOModel/

It’s open-source and progressing really fast! I noticed that our project has a couple more GitHub stars now! :) If you’re interested in collaborating on our project (or anything else), don’t hesitate to reach out — you can find our GoModel Discord link on GitHub.

Regarding ongoingai/gateway, I could suggest adding more AI model providers.

← PreviousPage 2 of 2