It doesn't. Nobody's freedom to use the original MIT code is taken away. Regarding my derivative work, if I never grant it to begin with, there is nothing to be taken away.