Nope: you forget that immigrants (legal or otherwise) increase demand for goods in their local economy which creates demand for jobs to fulfill these goods. Research shows that this demand creates more jobs than the immigrants "consume".
This seems a bit counter-intuitive to me, could you point me to any research?
Without them, we'd have fewer workers competing for jobs, which seems like a good thing, but we'd also have fewer jobs to go around because of decreased consumption.