Hacker News Reader

What's your use case?

I bet it is large-scale data crunching for labeling or categorization.

Probably not because this is usually not a time sensitive task.

High frequency trading? :)

Fast LLMs seem to be mostly useless, otherwise it wouldn't be so hard to come up with realistic use cases.

You think too negatively about its use. My company definitely needs it desperately.

If it did, you would be able to specify for what, you can't specify for what, so it doesn't.

I need to have the answers faster it is that simple, I don't want the users to wait for more than a few seconds.

I literally said it in my first comment, which is large-scale data crunching for labeling and categorization.

Why is it time sensitive?

Sorry, can't say just yet but nothing as dramatic as what was guessed below :)