Yes, but as you look deeper into the night sky, you see more and more stars (proportional to the square of the distance). These two factors cancel exactly.