I have done the same and it's great.
The main issue is that I used to spend the commute reading books. So I have basically exchanged "mental" excericse with physical excercise. I feel that listening to an audiobook while cycling is a bit too dangerous for an urban commute like mine.