Sure, but unless you're training them yourself they can still be compromised with poisoning or bias. They're still black boxes even if you're running them locally.
You give LLMs a dedicated OS to work in, let them do research or debugging and commit to branches, review and clean up those branches as you like from a trusted OS, then sign the commits and mark a PR as ready for review.