I think the idea is that the H1B isnt a general 'work visa', it is given because there is a position at a company for a worker with a specific skillset. So it makes sense in that framework. I'm not arguing that this is the right way, just what the reason probably is.