Illegal presence is a civil violation. Civil violations are not crimes (in the sense the law is divided into civil and criminal law):
https://www.findlaw.com/legalblogs/criminal-defense/is-illeg...
Sneaking across the border is a crime. Overstaying your visa (70-80% of "illegal immigration") is not a crime. It is more analogous to a parking ticket in terms of severity.
The thing is - for a long time immigration was not enforced because the legals paths were blocked off to create a class of cheap labor to drive the American economy. It worked, and it source mostly jobs which citizens did not want to do. (Not entirely, and yes it did depress wages)
It is a complicated issue.