the exercise actually warms you up quite a lot! you really just need protection from the wind, for your hands in particular. a quality set of mitts or pogies for extreme cold and ur good to go :)
I don't bike in winter, but 'Fat Biking' has gone way beyond fad here in Northern Michigan.. You see people commuting around town in them all winter long... a foot of new snow is not a problem for these folks. But it is a smaller city.
You just have to dress properly. Moving under your own power generates a lot of heat. You have to trap it, but you also want to avoid sweating. Also, you will want to eliminate skin exposure if it is very cold, like -10F.