If SmallTalk or Genera grew popular enough to satisfy the needs of billions of people and hardware devices, then they would be infested with evolved cruft as well. Systems may feel more "coherent" or "designed" with tight coupling. I'm certain that such systems systems would not have made the jump from servers to desktops to mobile phones like Unix did. They would have been replaced with something more loosely coupled.
The core principles of Unix are still there. It's just layered under a lot of cruft. It's true that much of it is caused by incomplete understanding. I've been hacking on Debian internals and this has become very clear to me.
People say FreeBSD is more coherent... it's been tempting to me to switch. But it's more coherent because it does less (has less features than) Linux or OS X.