This is interesting; I've written how I set it up here; https://christiaanse.ca/posts/running_llm/