I have a life story similar to you up through middle-school - second pick for G&T, bullied heavily, repeated physical abuse from peers, ended up hanging out with losers who were into drugs both in middle & high school. After that it diverges though - I switched to a charter school for high school, went to a top liberal arts college, then worked at a couple startups and had a pretty prestigious position at Google. I've still got some scars from that time, but on paper at least, I did okay.

For me, being separated from the bullies made all the difference in the world. And it wasn't separation as in "hang around only with other smart kids" - my charter school was academically worse than the public school that I left behind, and like I said, I hung around with the stoners, rockers, and drop-outs. But the charter school focused explicitly on building community and accepting people for who they were. In short, it made it a point to address the emotional needs of teenagers that so many public institutions conveniently forget about. That made all the difference in the world.

For you - if you can muster the money or get insurance to pay for it, I'd highly recommend seeing a therapist that works with trauma. This stuff sticks with you a long time, but it doesn't have to define your life.