Sadly being pro-legalization loses you older voters that were exposed to a lot more propaganda during the war on drugs - legalization is inevitable as we age out of those voters but it still is a semi-risky political stance.
Bear in mind that John Boehner (yea that one) is now hawking legal marijuana himself after years of publicly opposing it.