You need to put your real address as the from address in replies, not the duck address. DuckDG then strips out the real one and replaces it with the duck one, it seems.