There are lots of situations where being very cautious is objectively the best idea - so it is a mistake to categorically reject caution.
Being excessively cautious is a mistake when the stakes are low and the benefits outweigh the risks. It is also a mistake when a decision needs to be made and no new information is going to arise. But that is contextual. It is sensible when dealing with situations where mistakes are easy to make and costly to recover from.