I think Google is forced to charge $649 because of their relative experience in hardware, which exacerbates their already high labor cost. Perhaps they could've charged $499, but it would've resulted in an accounting loss.

Perhaps the next iteration of Pixel will be cheaper as they ramp up on hardware expertise and reign in on cost.