Don't worry about good code at a startup. Worry about building something people want. Once you hit hockey stick growth you can hire the technical talent.
Totally depends on the startup. Building a new blog engine? Sure, go wild. Making financial software? You need to be very careful, and write good, secure code.