For which applications do you need that kind of single user throughput? A lot of agentic stuff is tool-heavy anyways other stuff are better served by sub agents / parallel work for more throughput.
Would seem reasonable for hedge funds to devise a pipeline of tools specifically made to be taken advantage of by LLMs that do goal-based strategy at scale.