As much as people online complain about fragmentation, there is no evidence (yet) that the general consumer cares that much. "Google experience" devices are not outselling the customized devices.
People need to tone down the rhetoric, in my opinion. Android already is being "taken seriously". Let's not make small problems out to be big problems. Android doesn't have any big problems, as it's being adopted by manufacturers and consumers at a rapid pace.