the monumental fuck up was cancelling mysql backup and having all engineers work directly with the production database, what you did was INEVITABLE..