An arbitrary existing code base? Perhaps not. The portions I've been working on for any length of time? They will. They'll have unit tests, too.
Some kind of guaranteed initial state? Yeah, my tests will set that up every time they run, just like they'll set up everything else they need.
Now, if I'm working on Oracle-specific code, say, and I don't have an Oracle license for my desktop, I'm unable to do what I have so bravely stated that I will do. Also, if I'm thrown into a mess with no time to do anything but panic fixes, I don't have time. But never in my career has that been the case for long (maybe I'm fortunate...)