277 karma · joined May 30, 2016
2) Since it's unified memory, you won't have 96GB available.
3) I offered a solution that is usually recommended to the "gpu poor", if he's concerned with how much memory he would need.
4) I stated, that people already pointed out how he should be fine and that "gpu poor" doesn't apply to him.
5) "gpu poor" depends on what model you are trying to use. If you want to run Kimi or GLM you are still "gpu poor" even if you have an RTX Pro 6000 with 96GB of VRAM.
EDIT: just found this recipe repo, may wanna give it a go: https://github.com/noonghunna/club-3090
EDIT-2: this can also shave off a lot of context need for tool calling -> https://github.com/rtk-ai/rtk
Almost all means there have been ones before that were not open. So, no contradiction there.
"[...] In the coming days, we will also open-source smaller-scale variants, reaffirming our commitment to accessibility and community-driven innovation. [...]"
It feels dishonest to me.
[0] https://github.com/FunAudioLLM/SenseVoice?tab=readme-ov-file...
However there‘s s difference between CC (close captions) and subtitles, with the former being the verbatim representation (including sfx, music etc.) in my experience.
I already commented [0] on this 2 years ago.
Through their rigorous license process to operate road vehicles…yeah right.