You need suitable hardware (ideally a 3090, 4090 or an Apple M device with a decent amount of mem).
Then set up software - ollama for easy mode (but less control) or text-generation-webui for more control.
After that you can just try models. The subreddit /r/localllama has whatever is flavour of the week. The Mixtral model at like Q3 quantization is probably a good starting point