Manipulating people on a mass scale without their informed consent has always been considered unethical; its on you if you're trying to argue that its not.

And you're 'but what if a person does it' arguments are irrelevant - there's a clear difference of scale between the massively automated systems we're discussing and a single person with a pencil and paper.