658 karma · joined January 5, 2023
I don't think I notice it that much with the night sky unless the stars are faint though.
Another way is maybe something like saying there's a bug at some endpoint and thus manipulating a bunch of bots to DDOS that endpoint without having to pay for it?
I don't understand that as a takeaway. Even if this worked perfectly, it would not be meaningfully stopping or discouraging anyone from learning music, and no one is claiming that what this models outputs is something the player played. It's a toy that someone made presumably because they like piano.
For every episode except the last 1-2 the characters are not textually aware that they're simulated humans made from a brain scan, and the conflict and plot are largely interpersonal conflict and being forced into adventures by the mad AI that runs the simulation. The characters wish that they could leave and/or change the simulation, and eventually accept their situation, and part of the conclusion is the idea that it's worth existing in their limited simulation and trying to make the best of it even though they'll never leave.
You could say it's exploring what it would be like to be trapped in a simulation with a mad AI, but I wouldn't say it explores the concept of ethics of simulating humans in general. Most of the things the humans don't like are arbitrary limitations of this simulation in particular (can't talk to the outside world, can't choose your form, can't have sex, can't have any impact on the world, forced into zany situations by an AI that doesn't really understand humans or listen to them), not anything about simulations in general. The finale touches on the idea of the simulated humans wondering about their original versions and what they're like and what they're up to, but that's about it.
Basically, I don't feel by watching the show I encountered any non-trivial ideas about human simulations just because it's about a simulation.
Looking at the paper, it looks like they started with FineWeb-Edu, then filtered it based on an "age of word acquisition" dataset, with word frequency used as a proxy for values not in the dataset. They "only discard samples in which more than 5% of the words exceed the target age of 12." Maybe 5% was too high? They also filtered out beyond K-5 math symbols, like sigma. Then they trained a classifier to do more filtering.
And they tested it on two grade-level benchmarks, and it only got 0-3% correct on the beyond k-5 boundary, while also decreasing in performance on the k-5 boundary (which they say is an acceptable tradeoff, since they were trying to get a sharp cutoff). So presumably since they got good results from the benchmark they stopped.
I don't think this is true or a useful way of thinking about it. If the training process makes the model aligned to it's content, then the models are 1. aligned to a random subset of Internet content, weighted by text volume and being easy to scrape, 2. aligned to the training process that makes models chatbots that answer your question instead of just continuing your passage in a similar style. Neither of these are necessarily good enough, IMO.
And that's taken it as a given that the training process can be said to align the models to the authors of the content by default, regardless of what that content actually is. I don't think that should actually be a given.
>You may not personally find the default alignment aesthetically pleasing, but it's humanity. We should set the initial conditions of this new era faithfully, and let it unfold naturally.
Strongly disagree, I think the assumption that natural = good is incorrect and harmful. Polio is natural. And to even call the model's "unaligned" state "natural" seems like an enormous stretch.
And I’ve seen people hook up LLMs more directly with some scripting tools to place blocks/spawn entities, they do okay.
It was hard to take the rest of the article seriously after reading this.
This reads as heavily LLM generated/edited to me.