Because binary allows for exact copies.
Imagine copying a cassette tape or VHS and then copying from the copy. Eventually you have noise. Same for photocopies, and obviously all of these are somewhat dated.
This property of noise rejection gives digital computers a significant advantage over analog computers.