kripy

I wrote this as a daily briefing, also for myself. It scrapes around 45 sites that I have handpicked. Links are ranked based on shares across social platforms: the usual suspects.

I curate each issue based on what looks good each morning and send it out at around 7am AEST.

I wrote more about it here: https://www.kripy.com/alt-all-in/.

And I agree that these snippets have been around for a while but how else could you facilitate passing data back to ad exchanges? JavaScript seems to be the perfect tool to get the scale required to handle these types of interactions.

One thing on this approach: you are screwed if the website isn't using well structured HTML. Having to write rules for individual websites will become cumbersome and will break if they decide to change their markup.

I keep track of a few websites off the command line by doing a checksum of the HTML page and then doing a diff. It doesn't work if the HTML includes a timestamp but it does work for the websites that I am watching.