I'm hoping and actually expecting that eventually there will be a simple way to locally host a small model that is good enough for simple things. For a lot of use cases, the capability of free chatgpt one year ago was more than enough.

Maybe there already is! But last I checked it was a little bit of a mess of manually installing things from multiple websites with little documentation.