I guess that works but the term seems overly broad – WTC 3-7 are also part of the "World Trade Center". So what do you call that building specifically? WTC 1, I guess?
I usually hear people here in NYC refer to it as "One World Trade Center" which at the same time covers its building number in the complex, and the fact that it is a single tower as opposed to two.
Kinda like when people say they're going to "the city", they mean Manhattan. If you're going to Brooklyn, yes, that's part of New York City, but then you say you're going to Brooklyn, you don't say you're going to "the city".
Typically, I've heard "World Trade" when referring to 1 WTC, and "One World Trade" when needing to disambiguate.