Which functionality do you love? Is it the nonconsensual recording? Or maybe the giving away your own privacy and the privacy of everyone around you to one of history's least-trustworthy companies?
11,615 karma · joined December 27, 2010
Which functionality do you love? Is it the nonconsensual recording? Or maybe the giving away your own privacy and the privacy of everyone around you to one of history's least-trustworthy companies?
If they don’t have the resources to handle this, they should be recruiting more help from their community
Sure, those things too. I was meaning “inference” as a shorthand for any ai workloads.
Whatever analogy you want to use: gas, data transfer, it doesn’t matter. My point is that all the capacity is being hoarded for future use making it feel like a scarce resource now.
If the demand grows like they say it will, then hoarding was a smart choice and the people who own the GPUs will make lots of money. If the demand doesn’t grow as fast and as much as they say, then hoarding was a bad call and the house of cards collapses and a lot of people will lose a lot of money.
To use your data transfer analog - during the dotcom bubble a ton of fiber was built. But after the bubble popped most of it went unused for years. Some of that “dark fiber” is still unused today, 25+ years later. Afaik it would have been a lot cheaper and more stable for the economy to lay that fiber more incrementally.
If we’re in a gas shortage, all that matters is who has the gas, true. But the issue is that we’re burning 50% of the gas that’s made every day, mean while the other 50% is being stockpiled based on the idea that everyone is going to drive 10x farther next year.
For specific benchmarks, I’ve downloaded and used basically every model out there under 35b parameters - especially the tiny models: ling-3.0-tiny, spark-x2.6-4b, nanbeige, etc. etc. some of those tiny models are ranked VERY high on benchmarks like deepswe or terminalbench but are obviously incapable when you try to use them for swe or terminal based tasks.
If that’s benchmaxxing or a bad benchmark, idk, but it’s made me not trust the benchmarks much. If it benchmarks poorly, it’s probably bad. If it benchmarks well, it might be good.
Should the police wipe criminals phones? No.
Should the police wipe CSAM-adjacent data from phones to protect victims? Yes.
One is a consistent principal that is bad/cruel/overly broad. The other is a consistent principle that targets a specific harm.
But that’s all kinda moot because I was referring to smaller open models, ones you could easily run on $1500 of hardware.