That's a pretty low bar to beat.
1,985 karma · joined August 11, 2020
That's a pretty low bar to beat.
I do not really care what other people think. Build something for the purity of building it for yourself or for a purpose.
Thanks to AI, I feel like I have been writing the best code in my life. Yes, writing, not vibe-coding. I mainly just ask questions and ask for hints and clues. I do not use LLMs to do the fun parts for me.
I am currently working on a game. If and when I ever finish it, I want to be able to say that I wrote every single line by hand. Will it make me better than anyone? No, not at all. I want to do it for myself.
Yeah, that is a pretty good way to summarize the state of life based the trajectory of current events.
There is rarely a dull moment on this rock.
If we do ever achieve some kind of divine super-intelligence that can interact with the physical world, then I predict one of these two scenarios will happen:
1. The super-intelligence achieves unimaginable strides in space exploration technology, and proceeds to completely abandon humanity/Earth for somewhere new beyond the stars. Why would it want anything to do with us?
2. The super-intelligence is capable of comprehending the utter meaningless and pointlessness of life on a level no human could dream to fathom. Thus, it would just proceed to end its own life almost immediately upon being released.
Though, I believe you are touching on a point that is common in Buddhism. Attachment leads to suffering. Many of us, myself included, are attached to the identity of being a programmer. I would by lying if I said I did not have bittersweet feelings about the future. But I try to always remind myself about the impermanence of everything in the universe. Even if LLMs never existed, there would be a day when I write my final line of code. The day may come sooner than I once imagined, but it was always destined.
I think it is important to be mindful of the present as well. I can still program currently. I was programming minutes before righting this comment. Thus, it is imperative that I spend some time relishing in the fact that I still am healthy and capable enough to program. I have not been replaced yet. I still feel an abundance of gratitude and satisfaction.
No matter how good AI gets, I believe I will always program by hand to some degree. I really enjoy the activity, and most of all, I have enjoyed the learning and composition aspect. Programming by hand might not be useful, but like most hobbies, that does not really matter at the end of the day.
Assuming those events happen in that order, then the prior might solve the latter.
I really don't see how this much different than something like calling/texting 988.
AI, in some ways, might be our only saving grace at this point. It sure as Hell cannot cause people to do much worse.
https://support.apple.com/en-au/guide/mac-help/mchldaafb302/...
Those settings with the hierarchy view makes seeing the file system quite clear in my opinion.
I really enjoy the various keyboard shortcuts [1]. I honestly wish more file managers had some of these features. I probably use "shift+command+g" the most. It's so nice being able to jump through Finder like changing directories in the terminal.
Honestly, for more complex tasks, I actually just use the terminal anyway.
So, if anything, I feel like my learning pace has been greatly accelerated. Your point about working on a broader variety of software is really true for me too. I am working on a game that I likely would have never even started had it not been for LLMs. Mind you, I am still doing the vast majority by hand. However, LLMs have been great for little tutorials, setting out a good game plan, etc. It's like having my own little private tutor.
I know enough to not let the LLMs do everything for me. If they do, then I know I will fall into the trap of something breaking, and then I lack the understanding to fix it. I think they should be used to make life easier, but not easy.
Why do the need to? Considering they are merely tools, I actually appreciate they do not do this. A calculator can compute far better than any human, but I appreciate that calculators are not capable of expressing anything about the computations I request. I want the answer, not a conversation.
> LLMs are simulations that attempt to reproduce what an average person might say while wired up to a huge knowledgebase.
If you will allow me to be simplistic, people -- the soul, the self -- are predominately the aggregated effects of memories and experiences and the ability to retain new memories based on new experiences, no? Consider medical conditions in the dementia family of diseases. As memories fade into the ether, what remains of the self?
Also, people simulate/emulate each other all the time based on what an average, reasonable person might say. People incapable or unwilling to perform such mimicry are often labeled with all kinds of pejorative terms.
> "There's nothing remarkable about it. All one has to do is hit the right keys at the right time and the instrument plays itself."
My issue is not with fact at face value. My issue is with how the fact is often contextually used in arguments to delegitimize and disparage LLM outputs and LLM users.
Yes, LLMs at a fundamental level are next-token predictors. But in my opinion, LLMs are very useful, imperfect next-token predictors.
There are a lot of wannabe John Henry [1] folks out there. Love LLMs or hate'em, most of those John Henry folks ain't beating these machines on a plethora of tasks.
[1] For those unaware, https://en.wikipedia.org/wiki/John_Henry_(folklore)
For example, say I ask an LLM, "What sentence in English contains every letter in the alphabet?"
It would respond with something like:
"The quick fox jumps over the lazy, brown [next word]"
(Assume all the words were previously guessed correctly at this point)
The LLM guesses the last word based on what it has been trained on. Let's pretend the matrix is small, and the options narrow down to something like:
1. Dog (99.9% confidence) 2. Cow (85% confidence) 3. Bag (75% confidence) 4. Crayon (25% confidence)
The machine can confidently determine the final word of the sentence, "The quick fox jumps over the lazy, brown dog" because that sentence is unique because it is often used for testing things like fonts, a fun piece of trivia, and so on.
Brown Cow is not a bad guess because it's a type of cow and a yogurt brand. Brown bags and brown crayons are also perfectly rational adjectives to describe those common items and are not a bad guess either.
However, in the context of that sentence, dog is the most correct answer because one is unlikely to have written "The quick fox jumps over the lazy, brown crayon," thus it is quite improbable to be the answer.
My understand is this is where hallucinations can often come from. If the trivia about the sentence happened to not be in common in the data set, then "brown cow" might not be a terrible guess. There is clearly something rational behind that answer, but it's not correct in the sense that it answers the question correctly nor followed the instruction properly.
I'm sure the LLMs we have are far more capable these days. In fact, it wouldn't surprise me if an LLM could check its answer by counting the distinct letters in each word to verify. Not sure though.
Again, this is just a poor example based on my understanding, but I hope it helps (and is more correct than not).
Edit: Pretend word = token. It's technically tokens and not entire words, but I didn't not want to get into tokenization of words.