So why is this not talked about? The reason being: unlike H1B visas they are not easily quantified in terms of number of "human jobs" even though they are a factor of magnitude larger I would reckon. However, they can be measured by trade deficit that America builds up( because the money goes to that country) and you are right about which country America has the highest trade deficit with US (worth millions of jobs in USA).
So H1B visa is really a small fry, but delicious fry and easy catch and an easy problem to describe and easy to vilify.
Also, if the H1B visas were completely eliminated, its not like those jobs may stay in the US forever, companies may find alternate strategies to get less " important " work done by foreigners.