Yes, you don't rely on an LLM solely for medical advice. You use it to get orientation to look at other sources. In my friend's case, I was relaying to him what I learned when taking a similar drug, my doctor's cautions on stopping the drug, what the manufacturer says about stopping the drug, and the published dosing schedule.

I guess you're right about me having zero qualifications. I only have a lifetime of experience with treatments for the various conditions I live with and the dozens of drugs that have failed to treat these conditions. I've been forced into self-education (learning how to read the research papers and the manufacturer info sheets) just like any patient with a complex medical situation needs to do for self-advocacy. This knowledge has helped me catch doctors' prescribing mistakes. I wish I'd had the skill before one such mistake toasted my kidneys.