12,723 karma · joined September 9, 2011
They're using LLMs. The economics of this sort of retrofit has changed considerably with LLMs.
It's a) just a trial, and b) not just generating power so that cost isn't factoring in the other benefits.
https://artificialanalysis.ai/models/claude-opus-5-5?models=...
No, they are empirically useful, and only getting more useful. This is not even a debate anymore.
Re: surface roughness, I can understand that the powder grain size creates a sort of minimal structure size, and can in principle be the start of a crack if a surface grain gets knocked loose. Is that the sort of thing you mean? I can see that for any internal or external surfaces, and a rocket engine combustion is certainly applying a lot of heat and pressure on surface grains. Can this be alleviated by smaller grain sizes, or is there some limit there?
Re: repeated heating/cooling and internal stresses, this strikes me as just requiring standard post-printing stages like tempering to alleviate internal stresses.
Yes, and that statistically filled data is insanely useful. It remains true that it's a relatively poorly understood how this can be applied in various scenarios and what processes are needed to ensure robust results (or quantify the uncertainty).
DFlash2, Q8_0, --spec-draft-n-max=7: https://huggingface.co/z-lab/Qwen3.8-27B-DFlash2-GGUF
I run llama.cpp with -ctv=8, -ctk=q4. Vulkan has better throughput if you're doing single-stream decode, but ROCm has better throughput if you have "--parallel 2" or higher. If supporting parallelism, unified kv cache should be off, especially with Vulkan.
Of course, some of these may be specific to my card so try variations for your hardware. Hermes can concoct a test suite and run some tests for different llama.cpp parameter permutations to find something optimal.
Strix Halo has lower compute than the R9700 but the RAM is also slower, so not sure what would be the ultimate limiting factor.