Also a lot of people were porting stable diffusion/Llama to AMD I think
307 karma · joined December 11, 2015
Also a lot of people were porting stable diffusion/Llama to AMD I think
For people in this thread, please search for Llama-descended finetuned models in Huggingface. The newer ones with 65B and 13B parameters are quite good, maybe not exactly substitutions to GPT-3.5-turbo and GPT-4 as of yet but is going there.
I like Manticore-13B myself, it can write Clojure and Lisp codes! Unfortunately it doesn't understand macros and libraries though.
More realistically, Northern Jakarta is sinking, but the Southern part (and the suburbs/exurbs in the surrounding area) are still going to be okay and Jabodetabek will still be home to millions.
Maybe because Lisps have very low syntax, I find I can just copy off function/macro definitions as context and GPT3.5 can rewrite the code into something I can use... And by testing in a REPL (in :dev) I can instantly see which code has hallucinations and which work perfectly.
Tbh I find it hallucinates mainly when dealing with mutable states (e.g. atoms) or with pipelines of complex maps transformed by multimethods -
Just using small data bits and normal pure functions make GPT3.5 work perfectly because it doesn't need to take into account code outside the 2048-4096 tokens it's thinking right now?
Or if we can't do that (which would be weird since many complex mammals can hibernate already) then generation ships are possible. It'll probably be only done by culturally crazy groups, but hey! They're still counted as humans, and their expanding human habitats into new systems is still a win to us all.
So unfortunately the switch from biannual harvests to triannual harvests using factory-borne fertilizers and deep water usage was necessary.
(I was taught this in a fertilizer factory visit near Surabaya a few years back, so my information might be highly biased. But demographics data is there and ... It is what it is.)
*
On the other hand... Confucianism puts merchants as one of the lower members of society, because they do not add value as artisans. Edo Japan famously had caste of samurai on the top, farmers on the middle, and merchants on the lowest.
Human cross-domain capabilities are amazing.
And lots of people in the unaligned* world is ready to switch from San Fransisco to Beijing if the latter provides cheap LLM for commercial purposes.
* In the human sense of the world
Also Taiwanese military has some pro-One China elements in it last I've heard.
Political bias is a very weird thing to navigate for IT people. Especially when technical capability, e.g. AI-assisted translation, is above and beyond sensitivity to 'local needs' in each country, or even in each specific regions.
If I'm not mistaken, Debt: the First 5000 Years and the Dawn of Everything books examined this.
Your graph is a formalization of such relationship, no?
Anyway, back to the main point, thank you for the article. I'll try to play around with Dak later today and see if I can use it to do something fun. Play is better to learn something after all.
It's time to make our own Linux. Our own Emacs.
Go to open-assistant.io and other similar initiatives.
Unfortunately GPT-NEOX, LLaMA, and OPT-IML are non-commercial-only. We small scale players should make our own.
Please contact me if anyone is interested in this space.
"In terms of soldiers the French numerical advantage was offset by British subsidies that paid for a large proportion of the Austrian and Russian soldiers, peaking at about 450,000 in 1813."
[0] https://en.m.wikipedia.org/wiki/United_Kingdom_in_the_Napole...