Hacker News Reader

The event-scraping problem has motivated a year of technology development on my part. Parsley, Parselets, date_range, csvget, SelectorGadget, and a bunch of unreleased niftiness.

I've mostly moved on from the problem, but would be happy to talk to anyone who's interested, share my experience, etc.

I'd definitely like to hear more about your experiences. I couldn't find your email address in your profile, mine is jtoy at jtoy dot net

I'm also interested and tackling the problem myself. Contact me at kkouddous at gmail - would love to share best practices.

I was thinking about this. I'm not sure how the other sites did it, but I would try to write an algorithm that classifies whether a page has an event or not. If there is an event, then parse it and check for duplicates. I have some other ideas for easily allowing users to add events.

I would crowd source it.