Ugh this is way worse and actually seems far more likely and easy to accomplish than the public wifi thing...
E: And in the ongoing arms war, then manufacturer's ship remotes that no longer use tried and true IR but instead go over the same bluetooth or 2.4ghz chip. Some probably already do, I would expect.