I don't know much more about the computational photography pipeline, but I imagine there might be some tricky bits around focusing across multiple lenses simultaneously, around managing the slight off-axis offset (though that feels more trivial nowadays), and, as you say, around reading from the sensors into memory, but then also how to practically merge or not-merge the various shots. Google already does this with stacked photos that include, say, a computationally blurred/portrait shot alongside the primary sensor capture before that processing was done, so the bones are there for something similar... but to really take advantage of it would likely require some more work.
But this is all by way of saying, this would be really really cool and would open up a lot of potential opportunities.