You can bypass this problem by embedding relevant source code files directly in the prompt itself.

I built a desktop GUI tool called 16x Prompt that help you do it: https://prompt.16x.engineer/