While true, also false.
Take something like the Sony Nex series; mirrorless digital system camera. Not much larger than a (big) smart phone. Sure, bigger than an iPhone. But it might not be that difficult to fit the "rest" of a smart phone into one of those. In fact, it probably have all the parts: battery, (touch?)screen, microphone, wireless radio (not cellular, but that could be changed), speaker (maybe needs to be added).
But a better way to go would probably be some kind of light-field technology. I think that holds more promise for better pictures in a similar form factor, and the possibility of ease of use.