That's really only an issue if enough of the shareholders decide to sue or you're straight up abusing your position (i.e. embezzling).

Otherwise, you can always make some stuff up about it being a long-term strategy. But, fundamentally, making a bad call isn't a violation of fiduciary duty (unless there's documents saying you know it will tank beforehand and you do it anyway).