The Fifth Amendment to the US Constitution says "No person shall […] be deprived of life, liberty, or property, without due process of law." Since the Constitution is the supreme law of the land, that provision trumps anything that the president or Congress can do short of passing another amendment to modify that.
Denying a US citizen the right to travel without telling them why and preventing them from having any recourse to challenge it almost certainly violates that provision.