If you want to try Llama 2 on a Mac and have Homebrew (or Python/pip) you may find my LLM CLI tool interesting: https://simonwillison.net/2023/Aug/1/llama-2-mac/
Sadly 7b is not very good for SQL tasks. I think even with RAG it would struggle.
>How to speed this up—right now my Llama prompts often take 20+ seconds to complete.