If you are in Cambridge,UK you can visit the library which holds the books he collected (including his diaries): https://www.magd.cam.ac.uk/pepys
He designed the bookcases which hold the circa 3000 volumes shelved according to height. His will stipulated that the books are to be held in the library 'without addition or subtraction'