HN has slowed it down a bit but speed is definitely not where I want it to be. A lot of that comes from the openai side atm. Just turned on caching for the suggested questions so at least those are extremely fast.
I realize this is just one part of your product, but what if OpenAI goes away (not directly, but effectively)? Is there a contingency plan to move to another LLM? Build something else?