I found Mozilla's Transformer Lab quite nice to use, for very small and dabbling values of "use" at least. It encapsulates the setup and interaction with local LLMs into an app, and that feels more comfortable to me than using from the CLI.
Upon getting a model up and running though, I quickly realized that I really have no idea what to use it for.