HNHacker News
TopNewBestAskShowJobs

xbsd98

2 karma · joined June 9, 2020

submissionscomments
xbsd98··on Claude 3 Opus has an issue – Repeats same response over and over
Hmm, I mean to say that I have tried all different combinations of temperature, top_x etc parameters and all the responses are almost same, sometimes verbatim ...
xbsd98··on Claude 3 Opus has an issue – Repeats same response over and over
Btw, they give $ 5 as free credit when you sign up for the API, no credit card needed. The credit is good enough for testing Opus.
xbsd98··on Claude 3 Opus has an issue – Repeats same response over and over
Temperature ranges from 0-1 … I think the author might be referring to some other llms. See the messages API reference under temperature - https://docs.anthropic.com/claude/reference/messages_post

The last line says “ Note that even with temperature of 0.0, the results will not be fully deterministic.”

At least in this example, even temp 1 is nearly 100% deterministic !

xbsd98··on Claude 3 Opus has an issue – Repeats same response over and over
Code is at https://pastebin.com/fCu3Ji6n

To clarify -- I have tried this even with all ranges of temperature (0 to 1) ... it produces the SAME profile over and over.

xbsd98··on Claude 3 Opus has an issue – Repeats same response over and over
I have tried this even with all ranges of temperature (0 to 1) ... it produces the SAME profile over and over ... Since I couldn't get to format the code here, I have put it on pastebin -- https://pastebin.com/fCu3Ji6n

Any chance someone can try this out ? I am pretty sure it will be the same, something is odd (maybe it is too harmless with patient profile?)

xbsd98··on Claude 3 Opus has an issue – Repeats same response over and over
I have tried this even with all ranges of temperature (0 to 1) ... it produces the SAME profile over and over ... Since I couldn't get to format the code here, I have put it on pastebin -- https://pastebin.com/fCu3Ji6n

Any chance someone can try this out ? I am pretty sure it will be the same, something is odd (maybe it is too harmless with patient profile?)

xbsd98··on Show HN: Neuropod – Uber ATG's open source deep learning inference engine
Are there any examples of demand forecasting ? Thanks.