It's difficult to truly prove, but many women have noticed this and complained about it. It is only now that they are finally actually looking in to the possibility.
I find it incredibly ironic that people take it as a given that women's hormones might affect moods (PMS, anyone?), but then brush off women's concerns that taking large doses of female hormones might --in fact!-- have an affect on mood.