dacort

While I understand that real-time full-text indexing is a much more difficult problem to solve, I've got just under 1.5 billion tweets "indexed" in TweetStats. And I'm one person.

Granted, given the 30MM/day number they must be growing that index very quickly and they've likely hit that 1.5 mark pretty darn quickly.

That acquisition didn't actually happen. It was just rumored and TC never updated their article.

Sadly, no, you can't. Facebook seems to offload older data to systems that are inaccessible to third-parties using the graph API. Their "Download Your Data" feature has access to this tier via async methods.

Reference: http://bugs.developers.facebook.net/show_bug.cgi?id=10576#c7...

Just because the repository is empty doesn't mean the forkers didn't modify the code. I've forked many a project, modified it locally, and not pushed it back up for a variety of reasons not limited to: laziness, abandonment, and shameful code that somebody would likely write a scornful blog post about. ;)

Reminds me of Tentakel. http://sourceforge.net/projects/tentakel/files/tentakel/tent...

Came in useful from time-to-time.

I really wanted to be able to upvote from that interface.

We've been pretty happy with the scalability of Mongo where we use it for RowFeeder. We've got over 1 billion documents over several terabytes. The main challenge we encounter is our indexes are much larger than RAM, but given that we index by date this isn't a huge problem. Inserts are still very fast and only slow down if we have to load old data. 1.8's ability to distribute reads to replica slaves will help with this a lot, though.

I completely agree with this statement. In the software industry (and other tech industries like InfoSec), these type of certifications are fluff that anybody willing to spend a few hours studying a book can pass.

"most" being the key qualifier there. And there's no requirement that they do, so no means by which to qualify them. Some of the best never do go through that process simply because the state of the art is advancing so fast. I'm not sure any regulatory body could develop a standard and keep it adequately up to date.

But it does ensure a minimum bar for those licensed to practice professionally. So, theoretically (heh), even the worst licensed MD/architect/etc has met the minimum requirements for practicing. I'm not saying they can build an 80-story skyscraper, but in software we have no such means by which to measure potential practitioners.

And getting a pilot's license is a little bit different from being licensed to practice medicine. It also depends on whether you're referring to a private or commercial pilot. Private pilots only need 40 hours[1] of time in the air. And even once a commercial pilot is licensed, there are other regulations in place. And a driver's license is an even lower bar, of course.

So no, licensing (in any form) does not ensure that the licensee is "good" or "brilliant," but it does allow us to ensure a minimum bar that does not currently exist in the software industry today.

(And no worries, it's a pet peeve of mine as well. At least at it relates to the software industry.)

1. http://en.wikipedia.org/wiki/Pilot_certification_in_the_Unit...

"is there a process by which you can weed out the good Civil Engineers from the bad ones"

Yes, this the process of licensing. In those professions you mentioned, all people who (legally) work in the field must undergo a process of training and subsequent certification. This includes both work experience and exam requirements over the course of several years prior to certification. Yes, there are people that cheat the system, but the licensing exists to weed them out and protect the consumer.

Software "engineers" undergo no such process or requirements. I can learn ruby in my basement in a year, call myself a software engineer, and get hired building any number of apps. Is my work critical enough that someone may die if I am not certified? Usually not, so the need for certification isn't as strong. Nor have we had the time to develop such continuously relevant certifications in a field that changes several times a year.

I've been wanting (to build) this for a while. I have lots of different clothes, but usually stick to the same set of outfits.

Whenever I try something new, I have trouble knowing if it "goes well together" without some sort of outside confirmation. I've learned some basic tenets of what things "go with" other things, but I still don't branch out of that because of this problem.

Populating your library would take some effort, but it would be worth it.

Now couple this with another app/function that inventories your kitchen and lets you know what you can make for dinner and you've got a full blown bachelorator app.

As a former web application security guy, and now developer, identifying and disclosing vulnerabilities on websites is still very much a troubled area. Most companies don't have proper security@ email addresses set up or monitored, and still don't take kindly to vulns being reported.

That said, publicly disclosing a flaw in addition to defacing the website, even temporarily, is certainly not a classy way to go about it.

Yea, makes sense. That limit almost seems to fall along the lines of "Nobody should need more than 16MB for inline map/reduce results." ;)

Not really a big deal to just output to a new collection and query that.

And if you ever want to see NK yourself from the inside, check out http://www.koryogroup.com - took a tour with them a couple years ago and was an interesting experience.

Completely off-topic, but the first thing I thought of when I saw this was R-Studio, an old file/disk recovery software. I was surprised to see that the R IDE has a trademark on "RStudio" (in both US and Canada) given that the former has been around for at least a decade. I guess R-Tools just never cared to file for a TM?

Would you be able to use real-time updates for this to avoid polling? http://developers.facebook.com/docs/reference/api/user/ I'm not sure if it notifies you on friends changes or just the user that authed your app. I assume the latter.

Sadly, Chrome has started not closing properly on me. It starts with tabs not closing unless I close them twice. Then if I quit Chrome, the window disappears but the process is still running and I have to force quit. Most up-to-date 9.0.597.102 build on OS X. Sigh.

Cool idea - I have the same problem and once started tracking a "last contact date" in my OS X address book. Then I had an AppleScript that would go through and check that date and give me 3,6,9 month reminders.

I'd love something that would connect with Twitter and automatically identify when I say "we should meet up" with somebody and remind me to meet up. Because I nearly always forget when I say that, especially if the person is in another city.

As an aside, selling t-shirts is how Peter Shankman (creator of Help-A-Report-Out) got started with his own advertising agency. He saw an opportunity (Titanic) and capitalized on it by selling t-shirts that said "It sank. Get Over It."

Brief story here: http://www.collective-e.com/how-tos-and-advice/how-did-you/a...

Ah yes, I can confirm that. It's totally hosed when you're logged out since it redirects to the logged-out search page, instead of the integrated one when you're logged in. It also breaks the parameter encoding when it redirects. Nice.

You may want to look into royalty/revenue based financing. I don't know if your revenue is where it needs to be for that (i.e. revenueloan.com's typical investment makes $1-5MM in revenue), but something to look in to.

Odd, Safari 5.0.3 (6533.19.4) works fine for me.

I can click back just fine on Chrome...

Wikipedia annoys me like this with the mobile web client. If I click through a Google result to wikipedia, it redirects me to m.wikipedia.com and I have to hit back twice to get to Google.

As somebody that is frustrated by the Graph API nearly daily, their code is certainly not bug-free.

LinkedIn is pretty stingy about their ToS. You even agree to a on-site code audit if they feel your app is in violation (Section 1.8).

I haven't used Cubeduel, but I wonder if they're displaying user info in violation of: "Data gathered from one user's LinkedIn account/network may not be exposed to another user"

Given the huge traffic, not surprised if they're just throttled though.

The processes section intrigues. As the "CTO" in a 4-person startup, I'm constantly juggling between getting $hit done and documenting what the heck I did to get $hit done. Seems to be a fine balance.

As I realized after Twitter's "developer" conference last year, the era of the Twitter hacker is coming to a close (see http://twitter.com/#!/dacort/status/12005978721 and http://twitter.com/#!/dacort/status/12032959629). If you are not building a business on their platform where money will pass into their business, good luck.

And who can blame them, providing 100,000 user tweets isn't free. Not sure where he got the idea he would never have to start paying.

Turning off basic auth also hastened this demise - whereas you could once pull whatever data you wanted from Twitter using a simple curl command, now you have to figure out OAuth. It's not that much of a challenge, but it is enough of a barrier to entry to dissuade somebody who's got a couple hours on the weekend and wants to have some fun.

Finally, their partnership with Gnip is yet another indicator that this is simply not the days of the wild west anymore. You want the data, you'll have to pay.

Gave a go on my own rendition a bit ago: https://gist.github.com/745726