While your conclusion is correct, isn't it other later case law that permitted Fair Use? I don't think that is actually in the constitution.
That is a less extreme change than that from Plessy vs Ferguson to Brown vs the Board of Education, for example. And a good case can be made for freedom of speech trumping copyright; the Constitutional argument for copyright is a practical one for "encouraging" the advance of arts and sciences; eternal copyright has already undercut that argument.