NaOH, in large quantities, is an unforgiving material. As I've read my way into carbon-capture technology, I was saddened to find it there, too. HF also comes to mind in this direction (but is in another league). There's a correlation between those properties that make them useful and those that make them dangerous.
The most powerful counterexample to this notion that comes to mind, though, is water. What a spectacular chemical, one that is so useful we have built ourselves from it, yet we can also swim in it for hours without concern for any adverse effect beyond temporarily-wrinkly skin. (While it's less-relevant for thermal solar, it's darn good at heat-capacity, too! :) )