Looks similar to most other mid-level remote procedure call protocols, from XMLRPC to CORBA.
The usual sync, async, poll, progress test problems apply.
Things I'd expected to see and didn't:
- Client to server: "tell me what you can do". This has always been hard, but in the LLM era, it could potentially work, because a textural response would work.
- Similarly, being able to ask "How do I..." might be feasible now. It should be possible to talk to a new server and automatically figure out how to use it.
- "How much is this going to cost me?" Plus some way to set a cost limit on a query.