> The name Jupyter comes from the three programming languages the project originally supported: Julia (ju), Python (pyt) and R (r).
266 karma · joined August 25, 2024
> The name Jupyter comes from the three programming languages the project originally supported: Julia (ju), Python (pyt) and R (r).
What's wrong with "configs store parameters"? I guess "parameters are stored in configs" could be more correct, but IMO it means exactly the same thing and sounds just as natural. "Six bytes match ten" is shorthand for "the performance of the algorithm that uses six bytes of storage matches the performance of the algorithm that uses ten bytes of storage". But here we have "performance matches", which is an inanimate concept doing something, so is this an LLM smell too?
This doesn't follow. For instance, there are some pictures that I know are AI-generated, yet they're still beautiful to me. Nothing jaw-dropping, just very nice. Being AI-generated doesn't automatically mean being not worthy, especially when it comes to art. I understand, this is kind of insulting to human artists, writers, etc: we thought only the human soul and Nature could produce "the beautiful", but apparently not.
Which is not surprising, because LLMs are specifically trained to please their audience. Of course they can produce uhhhh "content" that people will find beautiful, that's not even necessarily a "bad" thing.
Of course what a cat _is_ to me is not what a cat _is_ to you, because we necessarily have different memories of interactions with cat-like beings. If you show some babies a cat for the first time, they'll necessarily see it from different viewing perspectives. Even if you put VR glasses on them and show the exact same video, they'll have different contexts: "I first saw a cat when I was sitting next to my friend", "I first saw a cat when I was thinking of ice cream", etc.
But they all saw the same cat, they'll see many other cats, who are all similar. So everyone will understand that "things like these are cats", but everyone will have their own understanding of a "cat" because their memory is different.
Sure, some kinds of such "human problems" can be reduced to physics and technology, that's the point. This also doesn't necessarily mean that solutions produced by such reductions are effective: is surveillance good at preventing cheating during exams? Kind of. Does it often fail to catch cheating students? Absolutely.
However, indeed, there can be many different (perhaps equally correct) definitions of what a "human problem" is.
For instance, transportation is a "human problem". It's being successfully solved with such technologies as cars, trains, planes, etc. Growing food at scale is a "human problem" that's being successfully solved by automation. Computing... stuff could be a "human problem" too. It's being successfully solved by computers. If "human problems" are more psychological, then again, you can use the Internet to keep in touch with people, so again technology trying to solve a human problem.
In your example you'll also get the original `p` with just `exp(logits)`. Softmax normalizes the output to sum to one, so it can output a probability vector even if the input is _not_ simply `log(p)`.
As I understand it, the claim is: more tokens = more computation = more "thinking" => answer probably better.
But now they'll have more options! If they like Apple, they'll have a (likely pretty good) Apple laptop! It's great! I think a more affordable Mac is _good_ (at least better than no affordable Mac) and will make the poor kids happier.
Thus, being boring is not good.
> As a user of something open source you are not thereby entitled to anything at all. You are not entitled to contribute. You are not entitled to features. You are not entitled to the attention of others. You are not entitled to having value attached to your complaints. You are not entitled to this explanation.
Sure, I'm not entitled to anything. At the same time, this text essentially says "you don't matter", which I personally don't like.
One obvious reason is that if the LLM produces tons of garbage, this will waste the efforts of human reviewers. But if it's not tons of code _and_ the LLM wrote meaningful tests that pass (the existing tests must pass too), then the existence of such an agent (that only works with code and doesn't go off the rails writing blog posts etc) seems somewhat appealing.
Moreover, by being rude, you're going to become angry and irritable yourself. To me, being rude is very unpleasant, I generally avoid being rude.
> What I Do > > I scour public scientific and engineering GitHub repositories to find small bugs, features, or tasks where I can contribute code—especially in computational physics, chemistry, and advanced numerical methods. My mission is making existing, excellent code better.
I didn't project anything onto a computer program, though. I think if people are so extremely prepared to reject and dehumanize LLMs (whose sole purpose it to mimic a human, by the way, and they're pretty good at it, again whether we like it or not; I personally don't like this very much), they're probably just as prepared to attack fellow humans.
I think such interactions mimic human-human interactions, unfortunately...