Hacker News Reader

Very cool to see North Carolina lead the way in implementation of products like Archive Social.

Seems like an easy technology to build, but it doesn't look like your team has taken any short cuts.

Kudos

I appreciate the comment. You are right that, on the surface, this is something fairly easy to say you are doing. There are lots of tools like Backupify, etc that store social media content in some way. The problem is that its virtually impossible to make sense of the data later on because most of the context is lost (i.e. comments are not associated with their posts, you cant view the full-sized photos, etc). It's also a challenge to preserve these ever-changing, non-standardized data formats over the course of several years, while maintaining searchability and accurate presentation of the data.

Reply on news.ycombinator.com