Then you don't understand quantum mechanics at all. You should read this:
https://flownet.com/ron/QM.pdf
The TL;DR is that measurement and entanglement are the same phenomenon. A particle can become entangled with a detector even if the detector doesn't register anything.
But that is neither here nor there. Why do you get interference with no detectors? Your theory is that a detector at one slit is somehow paired with a "virtual detector" in a parallel branch at the other slit. But why would that "virtual detector" go away when the real detector is removed? Why is it never the case that there is a "virtual detector" at either slit unless there is a real detector at one of them?