This sounds exactly like what Repoprompt was built for: https://repoprompt.com/
The community edition was open sourced when the creator got hired by OpenAI a few months ago.
The community edition was open sourced when the creator got hired by OpenAI a few months ago.