Hacker News Reader

Comment by gfodor | Hacker News Reader

I’ve been programming for two decades and you’re just plain wrong here. It’s useful throughout the dev process for many things, the worst part right now is just how slow GPT-4 is to run inference. You’re probably not using it right, aren’t using GPT-4, or something. It’s a multiplier, for specific parts of development - the amount of annoying nonsense I no longer have to spend my limited time on earth thinking about makes me want to cry.

View on HN

Also got a couple decades, a ChatGPT Plus subscription on top of running my own local instance of Vicuna and access to Bard.

Enjoy it while it lasts. The training set (Stack Overflow) will dry as people move away from it, resulting in model degradation, resulting in not having a useful AI AND not having a useful SO

I admit to using AI, but only for what I was using SO before. Which is 0% of the work I actually get paid for (maintaining existing software that requires expert knowledge). For personal projects, sure, it's useful. Want to code something in a new language? Great. You'll still be a beginner, and will have contributed nothing to the body of knowledge that has trained the model you are using

What? You're jumping to so many conclusions here, it's absurd. You're going to have to go into research for a few years if you want to get anywhere on proving that the capability of the current systems is somehow determined by the presence of StackOverflow. Sounds like you have a very tall tower of speculative assumptions about LLMs today, LLMs in the future, the evolution of the web corpus, and other big, dynamic, absolutely unknowable things.

This is starting to sound like a debate, but I feel that the burden of proof lies more in that LLMs are anything more than a blurry representation of the data they have been trained on than otherwise. I personally don't feel like I've brought Frankenstein to life each time I load a LLM into memory..

I'll be really impressed the day models can generate code by just grokking the language spec and documentation.

It can do that now. Has an 8kb (or 32kb) context. You might need to do a bit of work preparing a concise description and language examples.

Does anyone have any blog posts that elaborate on this?

Reply on news.ycombinator.com