280 karma · joined November 7, 2019
In-context learning (Few Shot Prompting) is absolutely demonstrable by LLMs since GPT 3.5 at least.
Those markets are frequently characterised by poorly maintained rental stock.
>Don’t you have a moral obligation
No.
Those markets are frequently characterised by poorly maintained rental stock.
>Don’t you have a moral obligation
No.
Public housing runs because the people administrating it have no disincentives to making poor decisions because ultimately it’s the tax payer who pays.
All this guarantees is a two-tier system. Owners and basic rental properties available.
Does this always follow though? Mass automation can just as easily make the existing staff far more effective, making the ROI easier to justify.
>taxes footing the bill.
It sounds like it is surviving only its own merits, merely shifted in time.
(Admittedly, from the perspective of an Australian whose strongest institutions are all public and the private universities are a bit of a joke)
Be better.
Whereas, if it was the norm for well used OS projects to be sponsored, it’s far less likely to be tempted by relatively small bribes.
I’d do a deep dive on verifiable credentials and ask yourself truthfully what PolyKey offers to both users and relying parties.
If you’ve got a peer-to-peer network of information nodes, where each person is able to assert information about themselves in their node, but the whole trust is based on the polykey binding at setup, I see 3 key challenges:
1) Where’s the real world verification of any identity attributes stored in the node? 2) How do we detect when/if the root key has been compromised, allowing arbitrary new vaults and identity attributes to be automatically trusted within the network?
3) How does this meaningfully improve the experience over having a CA sign a certificate that contains attributes about you? (sibling poster’s argument).
Foundational models (GPT-4, Llama 3 etc) effectively compress “some” human knowledge into its neural network weights so that it can generate outputs from inputs.
However, obviously it can’t compress ALL human knowledge for obvious time and cost reasons, but also on the basis that not all knowledge is publicly available (it’s either personal information such as your medical records or otherwise proprietary).
So we build Retrieval Augmented Gen AI, where we retrieve additional knowledge that the model wouldn’t know about to help answer the query.
We found early on the LLMs are very effective at in-context learning (look at 1-shot, few-shot learning) and so if you can include the right reference material and/or private information, the foundational models can demonstrate that they’ve “learnt” something and answer far more effectively.
The challenge is how do you the right content to pass to the foundational model? One very effective way is to use vector search, which basically means:
Pass your query to an embedding model, get a vector back. Then use that vector to perform a cosine-similarity search on all of the private data you have, that you’ve previously also generated an embedding vector for.
The closest vectors are likely to be the most similar (and relevant) if the embedding model is able to generate very different vectors for sources that superficially, seemingly related topics but are actually very very different.
A good embedding model returns very different vectors for “University” and “Universe” but similar for “University” and “College”
Fine-tunes lead to catastrophic forgetting.
RAG is only irrelevant if you’re completely disinterested in cost and latency.
We also don’t have enough data to gauge performance of models >200k context window size when reasoning over inputs of that size, much of which will be irrelevant to any particular user. Multiple random needles in haystack tests work flawlessly, but rarely applies to real world activity.
Yes, unless models are being live fine-tuned, but generally yes.
>What we call AI today does not use reason
I don’t think this is correct- I think it’s more accurate to say it reasons on its priors rather than from first principles.
For the most part, I agree with the rest of your post.
I read $100m and $1B as enterprise value, not ARR.
While the long term ARR multiple to EV is ~5.5x for SaaS, I could see niches where that approaches 10x.
So 5 customers, being billed 2m / year each at a 10x multiple, gives you a $100m valuation.
GPT-4 is likely to be a trillion+ parameters over its MoR models.
A third option: technology investments improved the efficiency of the previous tax base, which allowed the expansion of the tax base - through additional enforcement activity, increasing the tax base in absolute terms but also returning the overhead to its historical norms.
Without tracking the size of the tax base in inflation-adjusted terms, hard to account for.
(The cynically, you’re probably right re: useless bureaucratic expansion)
You’ve just posted a bunch of links that reference criticisms of Israel, most of which mention neither war crimes nor apartheid. Every nation has faults and the West Bank settlements are deservedly criticised.
They are neither apartheid nor a war crime, however.
Semantic Kernel is MS's response to LangChain and LlamaIndex - available for .NET, python and Java.
Using their Memory support (using Azure Cognitive Search), it gives a powerful RAG quickstart, which you can combined with Azure Document Intelligence to chunk your source documentation into memories that your foundational models can later use.
(Disclaimer: Its only very recently gone 1.0 and is still likely to undergo API change as the LLM domain itself is still rapidly evolving - I've substantially forked the project for my own needs, but I hope that as it stabilises, I can contribute PRs for some of my more advanced use cases).
ChatGPT is a consumer facing service that wraps the GPT-4 foundational model but at some point will likely wrap gpt-4-turbo.
Signing up for OpenAI API access or Azure OpenAI Services will grant you access to this model (with some rate-limits in place given its a preview model).
There's several references to various NGOs calling for action against Israel but as we've seen recently at the Harvard and other Ivy's, that's deeply murky territory.
That's very, very far away from your claim that the rest of the world generally accepts that Israel is committing war crimes and instituting apartheid. To repeat, its well established that the rest of the world generally (and increasingly) supports a humanitarian ceasefire in the region.