Cycling in Amsterdam is fun in a sort of stressy rollercoastery way. Utrecht is even worse.
If you're in the area though, I can highly recommend taking one of the many bike routes, in particular one that leads to the dunes near Amersfoort. From Amsterdam/Utrecht it's a perfect distance for a day trip and really beautiful.