I’ve created an honest, reproducible benchmark of self-hosted AI gateways literally two days ago. I posted it on HN here: https://news.ycombinator.com/item?id=48688213

To be totally transparent, I’m the author of GoModel, but the benchmark is fully reproducible. It might be helpful in making your mind.