You can read about it right here: https://www.law.cornell.edu/uscode/text/17/106
Those protections and no other does copyright afford.
You are describing your feelings, not a law.
Also, it probably is a crime to download a book from the internet (or you could live in Switzerland). The owner/operator of the server has pretty certainly committed copyright infringement. Merely receiving a copy doesn't constitute infringement. In civil court they could make the case that you caused the copy to be made by clicking.
What you do with the book cannot be controlled, save reproducing it.
But there's the crux. Does placing the words into RAM qualify as "reproduction"? The ninth circuit held that it did in MAI Systems vs. Peak Computer. The second circuit held that it did not in Cartoon Network v. CSC Holdings.
The supreme court will have to decide.