This is why lowering your caffeine intake is often at the top of the list to reduce stress. It actively raises cortisol, but this can be a good thing if you aren't chronically stressed. If you are chronically stressed, then you need to lower/avoid caffeine.
If you can lower your cortisol to normal levels, you can react much better to the situation you're in. I personally use Ashwagandha to do this, and I don't take it habitually, only when my stress levels are uncomfortably high. There may be another supplement that works better for you, or even something like going for walks. The point is to do something about high cortisol levels.