It also seemed to make sense to me otherwise we would not need to build large telescopes, we could just build lots of small ones and fuse the images.
No.
Light is a wave and a particle, and if you are getting wildly different answers from thinking about it as a wave and as a particle, and you're looking at a macro and not micro scale, then you're doing it wrong. That's why I answered your wave question with a photon count answer.
But how do you count photons without using probability amplitudes? If you count them by using a classical reasoning of photons being small particles falling from the sky, I'd say you're doing it wrong, because photons are not classical particles.
Many distant things, like galaxies, are very dim. M31 is almost visible to the naked eye, which is not dim to an astronomer. You might want to study astronomy before having strong opinions about it.