Infrastructure Patterns for Agentic Applications

I think it helps to keep in mind what an 'agent' actually is that makes these patterns relevant. It's just text into the context window as far as an LLM is concerned. All the control flow code is just an attempt to put the appropriate prompt back into an LLM and then use the resulting output

So once we start with that in mind it makes sense why you would want to use queues etc rather than a chain of immediate execution within an HTTP request: the output from the prompt can be a tool call or otherwise unexpected (a refusal, etc); it's not a standard API request

Every AI engineer needs to adapt their infra patterns for agents, and this is an incredibly helpful starting point

Article reads just like my 'AI generated' slob blog posts for better SEO.