These new mind enhancing drugs need not go down the path of adderall or other ADHD drugs. From my understanding those are based on amphetamine salts, with a host of well known societal issues like you mentioned.
Maybe they would follow the route of birth control instead. Initially seen as a moral repugnancy by many, but eventually accepted pretty much universally. It alters the body in significant ways achieving the desired effect as well as a few other hard to quantify ones.
We should be cautious of bad side effects, but they are not a given.