Related, there has been dozens of private data leaks in the last years in France
1,986 karma · joined October 2, 2016
Related, there has been dozens of private data leaks in the last years in France
So what’s the differenve ?
128GB is enough to run a large model, quantized, REAPed, with MoE and fast SSD for model weights
But constraints are not fixed, you can optimize, discover new techniques and change the space of requirements.
For example thanks to computer scientists we get better and better algorithms for compression, and thanks to hardware companies we get new / faster chips with different models to do new kinds of computation
Thus, you can move the compromise space, by working harder
How did they make vacuum and be sure it was indeed a vacuum ?
How did they melted that metal alloy into the right shape ?
How did they built those precise mirrors ?
How many times did they fail before succeeding ?
How did they lubricate and seal properly all components ?
I know I could explain 80% of those inventions easily by studying them for a few days each. I know I would never be able to build 1% of those machines myself, I'd constantly run into technical issues and it'd take me years for each
there is much less intellectual property in China so it’s not ‘theft’ (as you can’t put property on information)
"This isn't objective." Correct, and we are not pretending it is. We are not handing down a scientific verdict.
Actually, you are doing rational investigation in a fuzzy probabilistic new/emergent space, with open sharing to the world. I don’t understand why people downplay themselves and put on a pedestal others supposedly serious sciences.I dont understand why we are stuck in stone’s age with filesystems GUI
LLM are so powerful exactly because they can interpret unstructured inputs in so many ways, prompt injection is a feature not a bug
Juniors now need to be more skilled than before