1) A friend of mine once astutely commented that the diagnosis for ADHD was basically "middle class with behaviors which annoy female schoolteachers."
2) Boys tend to challenge authority from teens to early 20's to try and work out their place in the world. Most male teachers just roll with it until they have to make a sarcastic, embarrassing remark which short circuits it (never heckle a teacher or a stand-up comic--they've seen it all before). Female teachers tend to react more strongly. I suspect its a physical thing--boys start getting problematically large for most women about 7th or 8th grade and if, as a female, you don't nip it in the bud hard and fast, you can lose control over the situation.
3) Boys need male role models just as women need female role models.
4) Male teachers don't tend to view approval by their students as something useful or desirable (in the case of approval by the female students--it's downright dangerous). The better female teachers are in the same boat, but there are a LOT of female teachers that actively try to gain their student's approval.
If we stew all that together with an absence of male teachers, I suspect that you have more than enough unconscious bias to account for everything.