1,682 karma · joined March 21, 2016
Great men I admire: - Jimi Hendrix - Claude Shannon - Carl Sagan
E.g. some models expect very specific formatting of prompts. Some models give nonsense output at temperature=0.7 while others work great. Some models have been fine-tuned on chatbot-bot like instructions (ala chatgpt, so-called "Instruct" models) while others just autocomplete the given prompt. Very important to use the right combo to get the best results.
Didn't even get the card thinking I could use it with ROCm for hobbyist AI stuff but turns out it works great and having 12GB of VRAM is super nice.
"We perform the most comprehensive evaluation of Code LLMs to date and show that StarCoderBase outperforms every open Code LLM that supports multiple programming languages and matches or outperforms the OpenAI code-cushman-001 model."
So I'd assume not up to par with gpt4 or copilot. Can't wait to see it evolve from here!
If you or anyone else remembers, I'd love to watch
- fraction scaling: I don't need it
- Wayland: still using X
- hardware accel: I think that's true for chromium but IIRC there's a package with it and widevine (google-chrome-stablevon Arch AUR)
- nvidia: the AMD drivers are great and well supported (I've even been using ROCm to play with stable diffusion on my 6750XT)
- shooters: I mostly play strategy, puzzle, sim and 2D games. Haven't run into multiplayer issues yet but I'm sure there are some in the FPS genre with heavy DRM
Not for everyone but when I got my AMD card I stopped using my qemu virt-io VM w/ GPU passthrough and started using native steam with proton - much better experience all around and haven't booted windows ever since
They're basically kicking me out as a happy user. I would love to continue using Signal, not sure what the motivation for this change is in the first place.
Behold, the birth of a true computer virus!
Just incredible. Thanks for giving me a hearty laugh. Make sure to refill your pitcher of kool-aid, I see you're running low!