HNHacker News
TopNewBestAskShowJobs

fudoshin2596

3 karma · joined May 25, 2023

submissionscomments
fudoshin2596··on LLM workflows: Why not just run an experiment?
In so many channels I hear the question, "anyone know if this works" or "what's the impact of X" and I always think to myself, why not just run an experiment? Figured i'd outline a quick workflow that I think scales well for folks building LLM powered products.
fudoshin2596··on Anthropic's Haiku Beats GPT-4 Turbo in Tool Use
No fine tuning. Looks like he's do raw model capabilities with simple prompt. repo: https://github.com/parea-ai/tool-use-benchmark
fudoshin2596··on Anthropic's Haiku Beats GPT-4 Turbo in Tool Use
Yea, new tool calling now in public beta is way better. And avoids all of that XML they had before.
fudoshin2596··on Show HN: Unify – Dynamic LLM Benchmarks and SSO for Multi-Vendor Deployment
The cross region stats are actually quite helpful, this is cool!
fudoshin2596··on How has the ChatGPT model changed from March to June?
Interesting. I want to see the GPT 4 results also! But the impact of system message or not was an interesting discovery. Are system messages becoming more or less supported with the new models?
fudoshin2596··on Ask HN: How are you improving your use of LLMs in production?
Productionizing LLMs is a Multi headed chimera. From getting the vector db retrieval in order, to proper classification, monitoring, and reliable generations. Still searching for a solution to many of these problems, but https://www.parea.ai helps with the testing, eval, iteration part. Wonder what folks use for the vector db retrieval part?