[0] https://platform.openai.com/docs/guides/embeddings/what-are-...
[0] https://platform.openai.com/docs/guides/embeddings/what-are-...
I have a colleague who is gungho chat bot coding. The guy is smart, but ever since he started using it, he's adopted some weird ideas about what code should look like which are based on easily googleable chatgpt lies and he refuses to hear anyone else out. It's kinda sad how confidently wrong chatbots can infect people and stunt their growth...
"We can't fly into space, the propellers will have nothing to push against"
"We have rockets for that, they're more expensive but don't have that limitation."
"I see we're reaching the 'you're holding it wrong' stage with propulsion."
To people who understand the technology your reply is fair. But it doesn't account for the millions of people who don't and are spewing manic sentiment about it's capabilities on the regular.
A lot of companies adopt this strategy for broken technology because it fosters a cult like group of zealots for a short period of time while they go off and try to fix everything. In my experience it usually doesn't last long.
EDIT: found another way in which you're illustrating my point - yeah propellers and LLMs are great for flying under a hard ceiling. We need something entirely different to reach orbit. You can't just tell people to bolt on rockets to propeller driven aircraft, you need to invent something entirely different, like spacecraft.
At the end of the day, it remains a sequence completion engine. An LLM can only care about the statistical likelyhood of sequences, that the entire universe it exists in.
And if a sequence making a wrong statement happens to be more likely than, or close enough for the set "heat" of the algorithm to, a sequence denoting a correct statement, then there is a chance the model will hallucinate.
If it were otherwise, we would already have a good solution for prompt injection attacks, and we don't.
When you compress vast amounts of text into a model and query the model you can only get back information that is already in the training data set. It's inherently backwards looking, it cannot produce lowered entropy forward in time. You can't get more knowledge out of it, only less then you inputted in the first place.
Sounds like a bunch of effort. :/
ChatGPT is fun, and for some of what I do it's usable as-is, but for most people it'll be a tech demo for something that will be built in and hidden behind layers of stuff to make it suitable for their specific use-case. At least until the base models get a lot more capable.
half the complaints people have about chatGPT are because they’ve never bothered to try the—much more powerful—API
Something along the lines of "why bother looking at their API, when the existing thing doesn't work properly?".
You're saying it's better via the API, but the standard (non-api) approach would have to be good enough first to draw people in more I guess.
I think part of the problem is people are used to equate eloquence with intelligence and knowledge, and when that assumption doesn't hold, they assume it's all smoke and mirrors rather than explore its limits.