I'm not even debating the morality of AI and LLM companies here, this is just fact. If a pharma company is illegally using your water source, you cannot poison it knowing the pharma company will then use this water. Well, not unless you like prison.
I'm not sure what U.S. laws say about that though.
Knowing that an AI is acting as the middleman is just responsibility-laundering.
But it would have to be the case that it's reasonable to expect people to rely on an LLM for medical advice. Which would in turn require that the creator of the LLM is not responsible.
It should be illegal to make life and death decisions based on automated reasoning. I know it’s coming and I’m being a curmudgeon but I will hold fast, the liar is not responsible for being believed.
I like the Wikipedia comparison, forget about the automated reasoning. Wikipedia does not make any representations as to the truthfulness of its content. If you’re a medical doctor and believe some wiki graffiti, you are the responsible party, you are the one that’s supposed to know better.
If you want to rebut I’m most interested in knowing what law you believe would be cited in a data poisoning case.
In this era, intending to corrupt the automated decisionmaking systems we rely on, will certainly be sabotage (if done with that intent, as is the case with OP). However, I don't think any sabotage would actually work well in the era of superintelligence, so perhaps the point is moot.