Most people don't read many books as it is. That's sad, but it's true for a couple decades. Those people will continue not reading.
Of the remainder, some people will continue to read books because reading books is enjoyable. It's not a chore, it's fun, so there is no reason to try to automate it away.
Another portion of people who read books only read them to get through them. Usually that's either because they want to understand some idea in them, or sometimes just so they can say they've read the book. These are the people who will use AI to summarize books rather than reading them line-by-line. I have zero problems with that, personally. That's not existentially troubling to me at all.
Nah, not too worried. Not about this anyway.
The thing that worries me about the future of literature is customization. I think having a shared monoculture—even a canon—is a good thing that we should strive for. We need it, to be part of the same community. The day that AI can easily just spin out a book that's exactly what you ask for, there won't be any reason for any two people to read the same books, let alone the same twenty million people. That will just accelerate the cultural fragmentation and attended alienation our culture has been living through for a while.