I would argue that e-readers actually do need reasonably low latencies. The reason I still read books is because I can flip through pages quickly and glance over 20 pages a second as I look for the page with a certain pattern of text or an image.
Anything that needs to be browsed or flipped through, nope. Very few electronic versions are usable in this case, be they normal LCD screens or eInk.