"The best thing is to do the right thing; the next best is to do the wrong thing; the worst thing of all things is to stand perfectly still"
(taken from the wikipedia article on this topic: https://en.wikipedia.org/wiki/Analysis_paralysis)
I think this is pretty good advice - in a way, the only bad thing to do is nothing. Failure is the best learning tool, so make a choice and commit to it. When exploring a new field, working on a new project, or starting a new company, no amount of thinking about things is going to land you on the perfect decision every time. Its better to be decisive, even if it means making random decisions. Just be sure to take time to execute your decisions, time to reflect on how they went, and the courage to let them go if they dont work.