Did you look at LiteLLM at all? It seems fine but Bifrost looks interesting too.
The only reason I didn't go for it is I'm not a fan of Python dependency management, Bifrost is just a single executable that uses nearly no memory and is lightning fast.