While excess weight is an contributing cause, lots of underweight and normal weight people have sleep apnea. Much of it is just based on your jaw morphology.

Source: I am typically underweight, and I have sleep apnea.

I've known people who have had it, and were in their twenties and in excellent physical shape.