You would actually have more noise, or at least, not less noise. There is readout noise associated with reading the information out from each pixel. Using one bigger pixel would give you less noise than four smaller ones :)
https://www.sciencedirect.com/science/article/pii/S026322411...
"...show that an array of small independent sensors is always less noisy than a large sensor of the same size."