Google has a deal for Reddit’s data, so its models will have that information. I can see this kind of thing being a moat as well.
And yeah obviously you’re going to feel diminishing returns.
Going from 0 to 1 always feels like a bigger step than from 1 to 2.
I don't see this as a silver bullet but let's assume this is true and a differentiator. This kind of validates that building a robust model hits a data saturation wall at some point and the moat dries up.
Imagine OpenAI makes a deal with GitHub, Stack Overflow, and O’Reilly gaining exclusive AI rights to their content.
Now there’s no reason for anyone in software to use someone else’s models.
Anthropic could make a music generation model with an exclusive license from Warner music or whoever and own the music producer market.
This seems like a pretty straightforward plan assuming those rights could be obtained.
- Meta has its own
- Reddit is monetizing its
- Twitter was bought for its
- MS is trying to create one
- Amazon has a funhouse mirror version (reviews)
I don't disagree with this but this is a losing battle assuming the perpetual cat-and-mouse game of web scraping continues to lean to the scrapers.
To beat it means raising the walls of the gardens, making "data deals," hoping users don't move to the next thing, and aggressively protecting data via third party legal action.
This all strikes me as a very vulnerable and complicated moat.
I don't see a way Apple engineers its way out of that -- but they won't need to if open source models are good enough, or if capable models remain accessible (e.g. not first-party locked).
Ironically, it looks a lot like the Maps situation again...
Also let's not forget how corporations invent doublespeak and twist meanings. For example Apple may not resell private data but use it internally. Or it may use it internally only processed by scripts, and claim it is private because other human never saw it. Many other terminology manipulations can be invented if a stake is a few billions in cash.
I expect, if they do find they need it, they'll pitch it as an opt-in paid feature.
Pay us for these extra capabilities, and know that we're training on your data.
Which it is.
The public web is going to turn into even more of a dumpster fire once genai is fully digested by spammers. (Which is to say, once a 14 year old in a random country with third world GDP per capita can use it at scale)
Just my 2c.