Sure, if you have 100% self-driving vehicles with good vehicle-to-vehicle communications, you can even do intersections like this:
http://vimeo.com/37751380
However, there's one further requirement for removing traffic lights and lanes and such: no pedestrians (try to imagine crossing the street in the above simulation). If you believe that cities should be designed for human beings, then this is a real problem.
So let's say you want to remove the traffic lights and create a high-speed continuous-flow system comprised of lightweight energy-efficient micro-cars. How could you make this compatible with human habitation? By removing the roads entirely, and running the vehicles on cheap segregated infrastructure, either below or above ground.
Sound fanciful? This technology already exists, and is much more mature than self-driving cars. It's called "Personal Rapid Transit" (http://en.wikipedia.org/wiki/Personal_rapid_transit), and has been prototyped successfully for decades. The first commercial system began operating in 2010, and there are now three PRT networks in public operation (The Masdar Institute in Abu Dhabi, Terminal 5 at London Heathrow Airport, and a national park in Suncheon South Korea).
When it comes to self-driving cars, freeways / motorways will be relatively easy to automate, because they are already pedestrian-free continuous-flow environments. I expect to see vehicles available which can do that by the end of this decade, or possibly early next decade. Mixed-mode surface streets will be far more difficult, however, and while they are likely to become automated in the longer term, I suspect that this will only happen at very low speeds -- possibly as low as 10 km/hr, which is the speed at which humans and vehicles can interoperate in a truly safe manner.