Hacker News Reader

The pagination is not always done with page numbers, sometimes there are "next" and "previous" tokens.

True. Perhaps it could be done using a Link header, although that won't give you the total number of records.