I just don't see how one could argue that "exclusive Right" means anything other than exclusive. The intent behind the copyright clause is that when authors have exclusive control over their work, they will be incentivized to produce more. When you start carving out exceptions to their exclusive right, well then it's open season on what control they have, as "exclusive" can no longer be interpreted as to mean the plain understanding of the word.
Let's move away from the Dr. Seuss example and look at another instance of where artists have used their exclusive right to restrict distribution of their work. In 2015 the Wu Tang Clan produced a single copy of their 7th album "Once Upon a Time in Shaolin". The album itself then went on a tour of its own and was showcased at museums until it was eventually sold to the infamous "Pharma Bro" Martin Shkreli for $2 million. The contract he had to sign included the following genius clause:
"The buying party also agrees that, at any time during the stipulated 88 year period, the seller may legally plan and attempt to execute one (1) heist or caper to steal back Once Upon A Time In Shaolin, which, if successful, would return all ownership rights to the seller. Said heist or caper can only be undertaken by currently active members of the Wu-Tang Clan and/or actor Bill Murray, with no legal repercussions." [1]
The legend behind this album has now birthed a forthcoming Netflix documentary [2]. So here is a situation where the author's exclusive control over their art has birthed not just a documentary, which is art, but a legal document which I would classify as art. None of this would be possible in a world where an author's exclusive copyright doesn't exist or could be infringed if they choose to restrict distribution of their work. So I would disagree with your conclusion that it's hard to claim that restricting the distribution of work doesn't "promote the Progress of Science and useful Arts".
[1]: https://gizmodo.com/bill-murray-can-legally-steal-the-2-mill...
[2]: https://www.engadget.com/netflix-martin-shkreli-wu-tang-albu...