A queue? What else can you really do. Your server is at the mercy of OpenAI, so all you can do is queue up everyone's requests. I don't know how many parallel requests you can send out to OpenAI (infinite?), so that bottleneck is probably just dependent on your server stack (how many threads).

There's a lot of language being thrown out here, and I'm trying to see if we're using too much language to discuss basic concepts.