Hacker News Reader

Comment by lxe | Hacker News Reader

No local inference support as of yet at least.

    Here are a few things we’d be excited to support…

        Local inference through WebGPU
        Local inference through stable-diffusion-webui
        Desktop installation
        ControlNet tools
        Tell us what you want to see!

View on HN

Since I re-implement the Stability APIs with gyre.ai, it should "just work" for a local inference option.

I haven't tested though, and the API spec has lots of under-specified bits, so could be some stuff I need to tidy up.

(Alternatively, despite the post content, in the github repo there is already a webui plugin, no idea of current state).

Doesn't that just mean that local inference runs on the CPU?

Reply on news.ycombinator.com