6,954 karma · joined December 27, 2018
It does feel like we're reinventing the wheel with some of this stuff, except letting the LLM do things that used to be handled with deterministic logic in an orchestration layer.
Given the current capabilities of the tech, I'd still prefer to do things the old way and only inject the LLM at the point in the workflow where I need to actually generate content, like for the email body. Rather than giving the LLM tools and telling it to "figure things out" and execute end to end.
https://www.npr.org/sections/thetwo-way/2017/11/01/561337106...
That said, you have to distinguish between "good for the field of AI, the AI industry overall, and users of AI" from "good for a couple of companies that want to be the sole provider of SOTA models and extract maximum value from everyone else to drive their own equity valuations to the moon". Deepseek is positive for the former and negative for the latter.
The only thing it's not good for is the idea that OpenAI and/or Anthropic will eventually become profitable companies with market caps that exceed Apple's by orders of magnitude. Oh no, anyway.
Somewhere around the mid 1990s, "layoff" became just a euphemism for permanent reductions in force/downsizing.
All? Quite a few of the best minds in the field, like Yann LeCun for example, have been adamant that 1) autoregressive LLMs are NOT the path to AGI and 2) that AGI is very likely NOT just a couple of years away.
Text classification, clustering, named entity recognition, etc. are NLP tasks. LLMs can perform these tasks. ML models that are not LLMs (or even not deep learning models) can also perform these tasks. Is the author perhaps asking if the concept of a "completion" has replaced all of these tasks?
When I hear "traditional NLP" I think not of the above types of tasks but rather the methodology employed for performing them. For example, building a pipeline to do stemming/lemmatization, part of speech tagging, coreference resolution, etc. before the text gets fed to a classifier model. This was SOTA 10 years ago but I don't think many people are still doing it today.
That is correct, but you need to understand the context. It originated in the 1600s as a way for maritime law to deal with pirate/smuggler ships who were operating in international waters, not flying the flag of any nation, and with no registered owner. Charging the ship and its contents with the crime rather than an unknown individual made sense in that context. Applying it to a car registered in the United States, driving down a highway in the United States, and being driven by a US citizen makes absolutely no sense because standard law can and should deal with that situation.
The word "eventually" is doing a lot of work here. Yes, it's true in the abstract, but over what time horizon? We have to build products to solve today's problems with today's technology, not wait for the generalized model that can do everything but may be decades away.
This is exactly the problem and these two categories nicely sum up the source of the confusion.
I consider myself in the former camp. The AI needs to determine my intent (book a flight) which is a classification problem, extract out the relevant information (travel date, return date, origin city, destination city, preferred airline) which is a Named Entity Recognition problem, and then call the appropriate API and pass this information as the parameters (tool usage). I'm asking the agent to perform an action on my behalf, and then it's taking my natural language and going from there. The overall workflow is deterministic, but there are elements within it that require some probabilistic reasoning.
Unfortunately, the second camp seems to be winning the day. Creating unrealistic expectations of what can be accomplished by current day LLMs running in a loop while simultaneously providing toy examples of it.
Turned off WiFi and put phone into Airplane Mode. Verified that Bluetooth is still connected to the watch.
Go into the Connect app. There's a big red box that says "No Internet Connection."
Heart Rate is transmitting to the Connect App in real time.
However, if I try to run a Sync from Connect, it hangs and then fails.
Turn on WiFi and take phone out of Airplane Mode. Run a Sync from Connect. It completes successfully.
Confirmed - If you complete an Activity and want to sync your watch to your phone with the Connect app, your phone must have an Internet connection.
It's the latter. In 5 years, what we consider to be AI today will just be standard product features and the AI being discussed will be some new set of capabilities that are just being developed, and the same will happen 5 years after that.