So, possible to do by motherboard vendor, not necessarily enforced by AMD, expensive
10,128 karma · joined July 2, 2011
So, possible to do by motherboard vendor, not necessarily enforced by AMD, expensive
A pin on underside of CPU is reasonably cheaper especially with how they've got a sea of wires working for the humongous models replacing previous serdes-based approach
Also encountered many cases where a company simply didn't consider actually vetting what they put on contract against local law
But I concur with the question about hallucinations. Worst I ever got since 3.7 flash if not earlier was model drifting too far when working on something very much new to itself and not being critical enough, something mk ostkt fixed by adversarial critical review subagent
Zen 4 and newer consumer chips have 4 memory controllers (for legacy reasons shown as 2) which handle 32bit wide LPDDR5 or DDR5 interfaces (2x per dimm for DDR5)
The AM5 (desktop) socket has in addition to the 4x 32bit memory lanes, 28 PCI-E lanes (generally 16x for GPU, two 4x general purpose, one 4x to chipset), 4x combined DP/HDMI outputs, USB 2.0 port, 4 USB 3.2 Gen 2 ports. And that's just the major buses, there's ton of other components exposed (simpler IO, sound, power)
All of that counts to staggering 1718 pins - anyone remember when moving dual-channel K8 from 940 pin to 939 allowed removal of whole layer from motherboard PCB, making them way cheaper?
The high-end performance server socket from AMD has 6096 pins, significant chunk of it being the 24x 32bit DDR5 interfaces.
So unfortunately it's very much not easy to add more memory, and that's before considering issues with routing it on motherboard even if you accept changing shapes
In fact, one of the options Vinge considered was a "group intellect" formed from how humans communicate more thanks to internet
and just about "we cannot really predict beyond certain things" (Vinge's "Singularity" (1993) with its "opaque wall across future")
The semi-canonical Dune Encyclopedia (disregarded by Frank's son) differs vastly from prequels and generally points to it being a self-inflicted wound on humanity that opened the doors to widespread return of feudalism and essentially stopped humanity for a 10,000 years
There's huge upswing in using Vulkan Compute which works across NVIDIA, AMD, and Intel (and even others), and which is apparently much easier and stable to run on AMD
I remember their cheerful atmosphere about "geeks" getting pushed back down thanks to offshoring
Quite likely it exceeded that, some sensible numbers I've seen suggest between 800 to 1000 km/h final speed at impact
We got guidance that:
a) weights should be considered to be public domain due to "blender" aspect of training on otherwise copyrighted data (similar argument as to why stable diffusion weights can't be infringing - because any specific copyrighted work provides less impact on process than RNG)
b) model outputs should be considered public domain as far as "work done by model" counts - prompts/inputs done by human are copyrightable.
However, model output can infringe - essentially same framework as if you used a ton of Disney stuff in a drawing you made by yourself - since the drawing would remain what it is without the copyrighted information, it is infringing even if you did it from memory.
Similarly any human-made addition to model output are copyrightable, but to make an useful distinction there would need to be some significant work. So let's say you made an image that incorporated model outputs for parts of it - going back to "prompts" it also counts if you made a sketch/wireframe/etc. and then used a model to "fill in" or postprocess it.
Unless considerable amount of lobbying reverses it in a new directive/regulation, that's the case on model outputs - Originally I learnt of it from briefing prepared by lawyers regarding EU laws on AI.