Regular folks will not pay Anthropic, but NSA, NASA or research labs might.
I’m not implying this will be a good time for AI companies. I am saying AI as a technology can provide value without it being controlled by only 3 companies.
562 karma · joined July 6, 2017
Regular folks will not pay Anthropic, but NSA, NASA or research labs might.
I’m not implying this will be a good time for AI companies. I am saying AI as a technology can provide value without it being controlled by only 3 companies.
In the example it shows how much of the reason for an answer is due to data from Wikipedia. Can it drill down to show paragraph or sentence level that influences the answer ?
There’s the scenario where LLMs get more efficient in size, and to get 2026 SOTA performance you will be able to get it from consumer grade laptop.
Sure with a 1000B parameter you will get better performance but the average person will have it write some python script, not derive new physics equations.
So in a sense the demand for LLM intelligence with reach a plateau (arguably we are there today for avg person) so there will not be any subsidy required, because the avg person will not need the latest and greatest.
There’s not the same demand pattern for something like uber.
Given the example I saw about CRISPR, what does this model give over a different, non explaining model in the output ? Does it really make me more confident in the output if I know the data came from Arxiv or Wikipedia ?
I find the LLM outputs are subtlety wrong not obviously wrong
Curious of what we can get out of those constraints.
Asking “what day is today” vs “create this api endpoint to adjust the inventory” will cost vastly different. And honestly I have no clue where to start to even estimate the cost unless I run the query.
NVDA and cloud providers that are highly staked in AI would likely take a hit if a 70B model could do what Sonnet4 does.
But overall, AI is here to stay even if the market crashes, so it’s not really a AI bubble pop, more like a GPU pop.
And even then, GPU will still be in demand since the training will still need large clusters.
Presumably Java would also be pretty tiny if we wrote it in bytecode instead of higher lever Java.
In a way this is saying that there are some GPUs just sitting around so they would rather get 50% than nothing for their use.
Since LLM context is limited, at some point the LLM will forget what was defined at the beginning so you will need to reset/ remind the LLM whats in memory.
I had a similar project a few years back that used OSX automations and Shortcuts and Python to send a message everyday to a friend. It required you to be signed in to iMessage on your MacBook.
Than was a send operation, the reading of replies is not something I implemented, but I know there is a file somewhere that holds a history of your recent iMessages. So you would have to parse it on file update and that should give you the read operation so you can have a conversation.
Very doable in a few hours unless something dramatic changed with how the messages apps works within the last few years.
We already have an interface for agents, we call that an API. Why do we need to have AI click buttons, that eventually call an API. Just skip the middle layer and go straight to an API that does everything that system is capable of doing.
How are you determining red flags ?
Will an LLM be running every x hours analyzing news, so I can give very specific things to look for ?
Currently you need to use biometric or password to access your keys.
If you use the extension will it make a copy of the passwords locally, or does it still require biometric on every password access ?
Also would be nice to have logs and see exactly which passwords re being retrieved by the add on. I know it’s apple made but still feels like an extra vector.
Granted it might have to do with how I use LLMs. If you just blindly ask a question you increase the chance of hallucinations. If you give a lengthy input, and the output is highly dependent on the input than you will get better results. Think email re-writing, summarizing, translation.
Maybe they are trying to cut down on memory usage ?
Does anybody know if performance could be greatly increased if only a single language was supported ?
I suspect there’s a high demand for models that are maybe smaller and can run faster if the tradeoff is support for only English.
Is this available in ollama ?
Similar idea to those weather balloons we were talking about last year ?
Is that even possible in the ocean ?
I suspect a GPU is optimized for this operation all the way to software level. I can’t imagine apple will get performance benefits.
Maybe it’s cheaper or provides better access to hardware, but I don’t think performance is at play here.
I think there’s plenty of opportunity to exchange old videos, but I think it requires some human touch or deeper understanding of the movie to maintain its message.
The light and contrast and color is made a certain way on purpose, usually to convert whatever the scene is meant to convey. You can’t just mess with those things just so you add details.