Comment by schiffern | Hacker News Reader

Comment by schiffern | Hacker News Reader

Parent Full thread

  >telling an AI to "never fucking guess" is stupid and abusive.

"Telling" implies there's someone being told. There isn't.

This is literally no different from the (numerous) software comments that contain profanity.

  >Thinking its fine, is failing to add together the mindset that would generate such a prompt.  Its a mindset of someone upset, frustrated

Their mindset is healthier than yours, because they realize AI isn't alive. This is like calling someone "abusive" for using the punching bag at the gym.

Upset? Frustrated? Again, no different from writing a software comment that contains profanity. ;)

Its entirely different because a comment isn't compiled. It's entirely skilled. Conversely, a prompt is part of the input to an LLM while contributes to both its output and operation when agentic. Its dangerous operation and will lead to alignment issues. Its part of why negative prompting outside of a one-shot is a bad idea due to "don't think about a duck" issues.

In terms of the statement "never fucking guess": How does an AI _know_ what a guess is and what a guess isn't? Write me that function without infinitely looping context. Its a disaster of a prompt which has an unhealthy attitude as well as a tragic anthropomorphisation of the model.

> Their mindset is healthier than yours, because they realize AI isn't alive.

You're wilfully missing my point. Its not about "the AI having feelings" its about the operator having issues and as a consequence building an alignment issue into their output and causing problems. If you stack these sorts of prompts headless in yolo mode into capable models then you're asking for trouble.

Reply on news.ycombinator.com