I basically do this using self-hosted LibreChat. Can even use MCP with it.