If the candidate on H-4 visa is physically present in the country and is able to attend onsite interviews, this increases his/her chances and thus creates more competition with American workers.
And if the candidate has enough those specialized skills - what's the problem?
Counting out H-4 EADs [1], the spouse on H-4 has to apply for an H-1B, go through the lottery, prove his/her qualifications, and only then get a job. So no, being on H-4 does not automatically get one a job.
[1] at which point they are only one step away from permanent residency