The supreme court sure did take power away from the executive in Sacket v EPA, Ohio v EPA, and Biden v Nebraska, but it's likely that reasoning only applies to liberal presidents for the 6-3 conservative federalist society majority.
Might be a good thing that it would enable society to change faster because bureaucrats are slow to respond.
Then again, might not be the welcome change we want.