Yeah, I used to hate the Claude desktop app's Code tab, but it's actually pretty good nowadays. I actually prefer it now over claude CLI.
I think the only solution there is self-hosted inference (either local, or on your own cloud servers with open weights).