Yeah, as I've heard it described from other private pilots is that you should never have a hard requirement be in place X at Y time.
In other words you should always be willing(and able) to cancel a flight under any circumstances or areas of caution.