That assumes the noise is uncorrelated though (which the noise on a camera sensor generally would be). If the noise is correlated then averaging doesn't help.
All those compensate for the various ways light may enter the camera (lens mount, lens frontmount, telescope housing, telescope lenses and mirrors) and let you subtract those out after averaging your result.