Both are, I think, valid options. Depends on the workflow you're looking for.
7,570 karma · joined April 20, 2018
Both are, I think, valid options. Depends on the workflow you're looking for.
Frontier and open weights? Yes.
Frontier and _US_ open weights? No.
I'd expect a US open weights provider to suddenly get bought or go non-open if they get near Opus 5.5 anyway.
Seems unlikely. Maybe open weight at all near there? That'd be great.
"Normal" is probably not a very useful framing. We're currently in an interglacial period in an ice age. So, on one scale we'd expect ice there, on one scale we'd not. On another scale we're just waiting for the sun to swallow the Earth and burn it all away. What's "normal" out of that?
If you happen to be asking if the current human-caused warming is an issue, yes it is. The Earth doesn't care, and "normal" doesn't care. We do though, we're fucking up our environment pretty good and it's causing misery and death.
We've known what caused the effect for a long time. We did _not_ know how they achieved the nanoparticle mix and size in the glass, last I checked. This story is about someone actually taking the basic idea and making a real object.
You don't need to change many weights, relatively, to add capabilities or modify behavior. Look up LoRas for instance.
I'm of the opinion that post-training existing models is an area with a lot of benefit and fun in the near future (it's already being done here and there of course).
I doubt you _really_ have to know everything in this course to know how to do that, but I'd want this as background personally for it.
I've taken to just manually making it write a handoff file and clearing context completely. I'm pretty much manually compacting instead of my harness doing it. Feels weird, but it does work.
The practical grounds the digital, and the digital enhances the practical.
These people building on or tweaking open models is _great_, it should be encouraged. There's a lot of room to spend some effort improving models in various ways that the original creators didn't have time for.
The part that looks weird to me is some models get tested all up and down their effort level, but this one seems to just have been tested at the level where it will come out worst (I'd expect). Maybe it'll get more coverage over time?
I've also noticed the numbers (and relative rankings) change right after some model releases, which felt a little like someone didn't like who came out on top so they tweaked it.
Whatever agent will be more than capable of wiring that up.
Different forces and material properties are all at relatively different levels.
The one I know offhand that will mess with stuff is the square-cube law. If you double the linear dimensions of something, it's twice as big, linearly, but 4 times the surface area and 8 times as heavy. The strength of anything that depends on area (like friction) won't scale at the same rate as anything that depends on mass or volume or anything.
Not to mention I'm sure this thing can only print a few different materials. Unless those are also _all_ of the materials it's made out of, it couldn't even make itself.
The cryptgraphy community is pretty reasonable folks, on the whole.
In case anyone was curious what it's based on. (No judgement either way from me, IMO depends how well they did the post-training, which I can't tell).
The ~issue is though that they're using a pretty low quant, 2 bit. 4 bit are _pretty_ close to full ability, maybe degraded a bit. 2 bit is _noticably_ worse. It's about as small of a quant as you can get while still pretending it works, for this model.
This won't replace claude for you, unless you baby it a lot and are okay with it being kind or derpy.