Current tool calling just parses llm output for flags that indicate a tool should be used.

How would you do that when output is raw audio buffers. You would need your conditionals to be like: if (audioDataArraySeemsLikeAnEmail(llmResponse)) {}