> don't you still want that 5 to 15 percent of time back?

Guess it depends on the downsides.

Also, it's not like the time spent with an llm is zero, so maybe you save 2-7 % (depends on the task, of course)