Then let's explore that. There are some rights which aren't fundamental human rights... that is, you don't get them just by virtue of existing. Voting comes to mind, that's a citizen's right only.
The right to be present within the borders of the United States is another such right. If you aren't a citizen, you do not have this right. We might extend the temporary privilege to non-citizens, but it is absolutely at the prerogative of the United States... subject to revocation at any time. The idea that it can't just be subject to revocation (arbitrary or otherwise) is the dimwitted notion that there is a sort of second-class citizenship... that some not-really-citizens can be here permanently and we can't decide that we want them to return home.
So, if they can be deported (for reason, or none at all), the only recourse such people have is "I can prove I'm a citizen". If ICE isn't letting them do so, if they protest that they are a citizen and the ICE agent sticks his fingers in his ears and chants "I can't hear you" repeatedly, then that would be a violation of due process. The process which is due (among whatever other redundant triplechecks they should be doing) is to hear all such protests in good faith and evaluate whatever evidence such a person provides. I haven't heard of any refusing to do such a thing (but if they have, it should be grounds for termination).
I reject the idea that it is necessary or desirable to drag each of these foreigners before a judge to perform this function.
> is going to punish people the same way they punish criminals
I don't want these people punished at all. Punishment would be putting them in prison (where they would stay in the United States). If someone is trespassing on your property and you call the police, the police would punish them by prosecuting, convicting, and incarcerating. When they drag them from your property and tell them to get lost, that's not punishment. It's just removal from where they aren't permitted to be. It's still not punishment even if they cry that they don't want to go home.