It seems quite useful, congratulations.
I am also pleasantly surprised it is not suffering a "hug of death" following the presentation here. I am curious about the need in resources for your engine? What kind of hardware is it running on?
I am also pleasantly surprised it is not suffering a "hug of death" following the presentation here. I am curious about the need in resources for your engine? What kind of hardware is it running on?
backend: go/rust/python + gin + mysql + pinecone + es + redis + aws
llm: openai/azure + aws gpu + aws bedrock