I built CurioDB a while back with the same idea, but using Akka as the underlying framework. Persistent Redis with distributed transactions, embedded Lua and a websocket front-end:
533 karma · joined April 10, 2010
I built CurioDB a while back with the same idea, but using Akka as the underlying framework. Persistent Redis with distributed transactions, embedded Lua and a websocket front-end:
Yes I imagine the thinking there is similar in your project, eg: Redis/CurioDB :: Node/SocketCluster (https://github.com/SocketCluster/socketcluster).
Hardware requirements would depend on your usage of course, it's like asking about the length of a piece of string. :-)
Honestly though, the code probably needs a lot more eyeballs on it before it's production ready, which is why I posted it here.
http://blog.jupo.org/2010/01/26/linear-traversal-of-adjacenc...
No need for mptt either.
It's something we run out of band on a subset of our data, so it's never been performance critical.
I went through a similar process about a year ago for https://kouio.com (RSS reader). In its case I needed to coalesce closely matching RSS feeds purely for storage and performance. After trialling edit distance and various simhash implementations in Python, we ended up needing to look no further than the standard library's difflib.SequenceMatcher - I wish I documented my findings at the time, but I recall it was the best in terms of speed and accuracy.
Also you might not want to rely on str.isalnum for stripping punctuation. I made the same mistake here: https://twitter.com/stephen_mcd/status/506344236531212288
https://kouio.com/blog/kouio-your-mobile-rss-reader
You can also push articles out to a whole ton of services at once, including Evernote:
https://kouio.com/blog/sharing-is-caring
As for HN and Reddit, RSS is perfect for these - HN has its own RSS feed dedicated to front-page items:
https://news.ycombinator.com/rss
It gets even better with Reddit, each individual subreddit has its own RSS feed, eg:
http://www.reddit.com/r/systems/.rss
With kouio I group together all the interesting subreddit feeds under a folder called Reddit - then I can view them individually or all together at once.
Then everything else goes into various folders, with a couple top-level main feeds that I don't put into a folder at all, here's a screenshot:
My RSS reader (http://kouio.com after Google's shut down) has always been my complete command centre:
- Google Alerts
- LinkedIn updates
- Every issue/comment/star on my Github projects
- The exact ages of my children every day (via http://howoldismykid.com)
- New questions per tag on stack overflow.
- New messages for individual Google Groups.
and so much more.
I was just lost when Google Reader shut down thinking I'd lose all that, RSS really is the universal API of web data.
- Will using lang X over Y reduce total lines of code? That's less work, less time, less money.
- Are # jobs for lang X rising? Show some pretty graphs. We can't fall behind the market.
All of this is bullshit to an engineer, but precisely how you need to sell it.
Surprised you haven't looked at it - it's the most downloaded of all the Django CMSes.
Since then they "acquired" an entirely separate recurring payments company (I don't recall the name), and it was all just a bit too much of an integration mess at the time, when compared to Stripe who also announced their beta then.
As an Australian company selling to the US, we've kinda been left in the lurch with their AU beta.
When it was launched we were told they were working on being able to accept/convert USD into AU accounts, so at the time we (incredibly naively) started building our subscription code around their API, assuming it'd be ready by the time we were.
Almost 6 months later and all we can get out of them is "we don't have an eta but we're working on it", and we've been sitting here the whole time losing money hoping that it's just around the corner, when really we should have just thrown out the work we'd done and gone with a provider that can already handle it.