The car sends a photo of the sign back to google and a user decodes it in a CAPTCHA.
(I'm mostly joking, but the answer does seem to involve big databases of what the signs and roads are expected to be. I'm not convinced that most of the current "self-driving" solutions can cope with roadworks, traffic cones, diversions etc)