It sounds like it's less about the type of lens that they use and more about the fact they put the cameras in awkward places (presumably to preserve the aesthetic of the car), looking down and looking up in ways that make it hard to judge distance.
It doesn't help that they also chose to avoid using lidar or radar, because Musk was adamant that if human eyes can do it with just visual light then his computers would too.