101 karma · joined April 10, 2020
Even if in the repo it is stated that it is optimized for big models (needing A100/H100), I still feel this can help with smaller models more than large ones.
We can extend “If you build it, they will come” with “If you provide the tools, the will build”
I don’t know if choosing different models for the same consumer can be problematic (seen as not consistent), but maybe using this approach will force the post-processing code not to be “coupled” with one particular model.
I'm just starting and the first impression is pretty good!
I failed every single try, and after some time I began appreciating qualitative indicators.
Also, Chris Olah’s articles are lovely (Anthropic and also distill.pub ones)
maybe for this use-case is it better to execute the vision tower on a GPU and leave the LPU for the language part?
s/he who is without sin…
Our IoT device was not selling well because it lacked one RS-485 port… and then a 4-20mA interface, and then…
I really hope to start using Rust in 2023, probably for some kind of API gateway experimentation
LoG conference is free to attend and online :)
“I want to travel from Seville to Berlin next October, avoiding weekends, for a two or three nights stay in a hotel by the river. Direct flights preferred.”