Great hardware, but I can't stand MacOS anymore after switching to Linux on home dekstop. KDE is such a breath of fresh air after years of dealing with Apple's idiosyncrasies.
I think I'll keep my Framework 13 Pro preorder.
202 karma · joined June 6, 2019
I think I'll keep my Framework 13 Pro preorder.
Why ask FABLE 5000 to "summarize this email thread" when a tiny model can do the job?
Sure Codex3000 can oneshot your backlog, but why not use a subsidized subscription to do it for now? We're clearly not at the peak of these model's capabilities yet.
HDR still doesn't work properly, there are no codecs (Atmos, DTS:X) for my surround system, latest nvidia driver broke Microsoft Flight Sim and other games on wayland. The list goes on.
And as for Copilot - I'm sure I'll be able to rip it out, just like the other crap MS forcefully pushes on people.
This potentially could change the whole collectable market, since you could fish for expensive rares and dump the "dud" packs back on the market.
They ship a k8s operator that deploys Synapse, will try that later. Supposedly it's free up to 200 users. But it seems like there's 0 documentation past the README.
Good opportunity to think about mirroring your repos somewhere else like Gitea or Gitlab.
Nobody complained when YT was monopolizing online video because it was convenient and free and then they proceed to bait and switch us into paying.
Screw them, I won't pay out of principle.
They bait and switched us.
Youtube killed private video hosting. Reddit killed small thematic php-bb forums.
If people knew that they'd eventually do that, none of these platforms would be as big as they are today.
Man I would love to work for a company like that. I don't know why more people don't set their startups like that.
Sure it looks different, but I'm still dragging windows on a virtual desktop.
You'd think there would be some innovation. For example I've always dreamed of a scrolling-timeline-like interaction with desktop, where your activities would scroll to the side when you switch to the new one and then you'd be able to "scrub back in time" to see what you were doing before.
Works on all platforms, but runs much better on Linux.
Running this in Docker on my 2080Ti, can barely fit 13B-4bit models into 11G of VRAM, but it works fine, produces around 10-15 tokens/second most of the time. It also has an API, that you can use with something like LangChain.
Supports multiple ways to run the models, purely with CUDA (I think AMD support is coming too) or on CPU with llama.cpp (also possible to offload part of the model to GPU VRAM, but the performance is still nowhere near CUDA).
Don't expect open-source models to perform as well as ChatGPT though, they're still pretty limited in comparison. Good place to get the models is TheBloke's page - https://huggingface.co/TheBloke. Tom converts popular LLM builds into multiple formats that you can use with textgen and he's a pillar of local LLM community.
I'm still learning how to fine-tune/train LoRAs, it's pretty finicky, but promising, I'd like to be able to feed personal data into the model and have it reliably answer questions.
In my opinion, these developments are way more exciting than whatever OpenAI is doing. No way I'm pushing my chatlogs into some corp datacenter, but running locally and storing checkpoints safely would achieve my end-goal of having it "impersonate" myself on the web.
I understand the unwillingness to attach your brand to whatever porn that inevitably comes out of making it available for everybody, but maybe don't use such big words then.
And it's getting easier and easier, just search Steam for "meme-games". Game development is more democratized than it has ever been.
Look what happened to music production, how easy it is to start with all the free DAWs and cheap hardware. I believe game development is going down the same road, as tools are getting more approachable for newbies, we're going to see an even bigger explosion of indies.
Man I can't wait to retire in 30 years, the games are going to be sick.
sudo tcpdump -i en0 -n -l dst host 8.8.8.8 $(for a in $(curl -s https://raw.githubusercontent.com/berthubert/googerteller/main/goog-prefixes.txt); do echo or dst net $a; done) | while read; do tput bel; done
I'm hopeful for this feature, but I'm not sure how scalable it can prove to be, to help manually rank pages for myriad of topics.
Hosting email is just too much. Big providers just treat you as guilty of spam, unless proven otherwise. Just too many hoops to jump through.
Hoping someone would dump this on trackers somehow.