If the cars were safer and more aware of pedestrians, like what we have seen from google car demos, I would be much more confident crossing the street, etc.
That said, I would be interested in seeing how driverless cars perform at stopping in the case of sudden and unexpected obstacles compared to human drivers?