Chatbots are now prescribing psychiatric drugs

theverge.com

15 pointsBrajeshwar4 comments

This is insane. The whole point of the modern pharmaceutical system is to ensure that people are given the medication they need, not what they want.

Knowing how easy it is to jail-break LLMs, it's conceivable that this allows a knowledgeable attacker access to whatever prescription medication the system has the ability to administer.

If a corrupt pharmacist is criminally liable for abusing their power of the pad, then someone either on the private side or governmental side of this needs to be held to the same standard for "solutions" like this.

> Legion Health’s AI chatbot to renew certain prescriptions for psychiatric medications, in some cases.

Probably better that they get their medication rather than waiting for an appointment if it’s keeping them from being psychotic or otherwise causing harm or being harmed.

If it keeps bipolar people on their meds, it will make the world better and safer, but also, those meds should just be able to be setup as "always fill this" in a saner system.

Reply on news.ycombinator.com