Whoa, this is really neat. Does this mean that I can essentially try any LLM on my local machine?
EDIT: We don't let you run stuff from HF, but we are trying to repackage the popular models. The plan is to let you upload your own in the future to share them.