Great & motivational comment. Any pointers on where to start playing with the internals and sampling?
Doesn’t need to be comprehensive, I just don’t know where to jump off from.
Doesn’t need to be comprehensive, I just don’t know where to jump off from.
This ofc implies local models and that you have a decent cpu + min 64gb of ram to run above 7b-sized model.
https://github.com/oobabooga/text-generation-webui
https://huggingface.co/models?pipeline_tag=text-generation&s...