In more recent versions of GitLab, you can change the project level visibility in a separate drop-down, this will allow visibility to all, but continue to restrict push access.