At some point in my career (I've been doing software for 22+ years professionally) people started taking me really seriously. I could no longer make certain jokes and I had to be careful about my opinions because they were taken (in many cases) as "the right thing to do".
So I got in all sorts of trouble, because I didn't want the leadership at the time. At some point I finally embraced it and actively started figuring out what kind of leader I should be.
After that point, it has gotten a lot easier. I even started enjoying it.
Leaders lead even when they don't intend to. So if you're one (willing or not), you should take the responsibility do your best to make the team thrive.
I think it as: Company > Team > Self in terms of goals, if I cannot accept that, I'll move on to a different gig.