Asked based-30B the same question since I have it loaded, it said:
> I don't know. It might work, but it would be a very dangerous way to do it
Ngl, that's pretty based alright. I mean the world record is 24 minutes after all.
> I don't know. It might work, but it would be a very dangerous way to do it
Ngl, that's pretty based alright. I mean the world record is 24 minutes after all.
There's a web gui for llama.cpp that is really straightforward to set up for huggingface models: https://github.com/oobabooga/text-generation-webui