Wait, so now anyone who wants to index Facebook can, as long as they don't crawl? Obviously, that's not true. So what's the deal? Does Facebook now have warrants in ark.com or something? There must be some quid pro quo.
they are probably using the graph api. Which doesn't give you access to much data for most people (As we're all trained to limit what other people's apps can see of us)
Absolutely correct. We are using the Graph API. The magic comes with you do link analysis and cluster it with other public data.