I built this Nose plugin inspired by Google's CI system: http://googletesting.blogspot.com/2011/06/testing-at-speed-a...

Hope it's useful.