It would be really nice to have dataset available for researchers with username, their posts and their comments. As an example, we could use the "SPEAR Algorithm"[1] to find expertise in specific domains per HN user.
you don't have to scape the site, RTFM. The official 'hnsearch' api will most likely yield the info you need ~ http://www.hnsearch.com/api
It sets a crawl-delay of 30 seconds.