I'm not saying though, that this is a criteria for calling any machine a computer. But it's probably what sets Zuse's achievement apart.
UPDATE: I've just learned that Babbage's language was also Turing complete. So Zuse's achievement is solely having physically built the first working computer, while Babbage's machine was never realized.