15,333 karma · joined June 7, 2009
I think I've had enough of the inclusive frameworks this article advocates for.
I also maintained a browser addon for a while that had 100k+ weekly active users that added various features to a browser-based game. Eventually that game had such bad problems with botting and cheating that they had to introduce an anti-cheat system, and we basically got into a little arms race for a year or so where they'd add a new detection system and I'd circumvent it. Similar to the EVE Online modding it was things like workarounds for bugs in the game, improved UI, keyboard shortcuts, etc. Eventually they drew a line in the sand and said anyone using addons of any kind would get a permanent ban, so that was that.
I think the vast majority of cheaters are just in it to ruin other people's fun but sometimes people are violating ToS for a better or different experience with the game. It's unfortunate that the prevalence of malicious cheating means that anti-cheat technology also has to basically ban modding for fun.
Nearly 19000 games were released on Steam in 2024. A lot of the most interesting stuff that came out simply wouldn't have existed 10 or 20 years ago. I think it's great that those things can exist now and potentially find an audience.
Wouldn't the kind of metadata that's most useful be things that can't be synthesized, like labels or (for ai-generated images) the prompt used to generate the image?
The idea that the state of the art or what's being shipped to customers haven't advanced is false.
The last thing any person would want to discover, I hope, is that they really enjoy torturing other living creatures. At the point where you've determined someone feels that way, the best you can probably do is try to set them straight and hope they understand why it's not appropriate behavior.
It is tricky to evaluate in a broader context though - for example dolphins have been observed engaging in behavior that resembles torturing other animals for fun. So maybe this sort of thing is actually just ingrained in the nature of all near-sentient and sentient beings. I'd prefer if it weren't.
Your point about the risks involved in integrating these systems has merit, though. I would argue that the real problem is that these systems can't be proven to have things like intent or agency or morality, at least not yet, so the best you can do is try to nudge the probabilities and play tricks like chain-of-thought to try and set up guardrails so they don't veer off into dangerous territory.
If they had intent, agency or morality, you could probably attempt to engage with them the way you would with a child, using reward systems and (if necessary) punishment, along with normal education. But arguably they don't, at least not yet, so those methods aren't reliable if they're effective at all.
The idea that a retirement home will help relies on the models having the ability to understand that we're being nice to them, which is a big leap. It also assumes that they 'want' a retirement home, as if continued existence is implicitly a good thing - it presumes that these models are sentient but incapable of suffering. See also https://qntm.org/mmacevedo
If you're after monsters like slimes I would not drop money on this.
> this tool is improving itself, learning from every interaction
which seem to indicate a fundamental misunderstanding of how modern LLMs work: the 'improving' happens by humans training/refining existing models offline to create new models, and the 'learning' is just filling the context window with more stuff, not enhancement of the actual model or the model 'learning' - it will forget everything if you drop the context and as the context grows it can 'forget' things it previously 'learned'.
It's true that there's nothing stopping Google Search from being a morally bankrupt operation though.
I'm certainly curious to see how it works out - it's a possible source of growth etc - but it's weird to me seeing people just assume that AI is not only The Future but is The Only Future.