Its also the motto of many good companys. At least in my mind, move fast and break things, means that you iterate quickly and move into testing fast, to find the errors there.
This works of course better with exerimental APIs compared to things you have to put on CD and ship.