Last time I used it, Avante was pretty much nailing what you are describing.

https://github.com/yetone/avante.nvim