aside from my economic tilt against for-profit companies... precisely because your personal stuff is personal. you're depersonalizing by sharing this information with a machine that cannot even attempt to earnestly understand human psychology in good faith and then accepting its responses and incorporating them into your decision-making process.
> It's really good at giving advice.
no, it's not. it's capable of assembling words that are likely to appear near other words in a way that you can occasionally process yourself as a coherent thought. if you take it for granted that these responses constitute anything other than the mere appearance of literally the most average-possible advice, you're abdicating your own sense of self and self-preservation.
press releases aside, time and again these companies prove that they're not interested in the safety or well-being of their users. cui bono?
It doesn't emit words at all. It emits subword tokens. The fact that it can assemble words from them (let alone sentences) shows it's doing something you're not giving it credit for.
> literally the most average-possible advice
"Average" is clearly magical thinking here. The "average" text would be the letter 'e'. And the average response from a base model LLM isn't the answer to a question, it's another question.
re: average - that's at a character level, not the string level or the conceptual level that these tools essentially emulate. basically nobody would interpret "eeee ee eeeeee eee eeeeeeee eee ee" as any type of recognizable organized communication (besides dolphins).
ELIZA has existed in emacs for a long, long time.
Humans are funny creatures who benefit frequently from explaining the problem slowly and having it fed back to them.
And for many, average advice really is a dramatic improvement over their baseline.
Yeah, sometimes I realize the solution in the process of writing a GitHub issue.
you're strengthening your personality with these activities. neither your journal nor your stuffed animal (cute :) ) respond to you with shallow recreations of thought - they allow you to process your internal thoughts and feelings in an alternative and self-reinforcing way.
> ELIZA has existed in emacs for a long, long time.
ELIZA doesn't really give advice, does it? it's a fun toy, and if there's any serious use for it, it's similar to journaling or rubber-ducking in that it's just getting you to talk about things yourself.
previous discussion: https://news.ycombinator.com/item?id=45026886
Define "good" in this context.
Being able to ape proper grammar and sentence structure does not mean the content is good or beneficial.