2,597 karma · joined September 17, 2013
Twitter: @betolink
https://keybase.io/betolink
[ my public key: https://keybase.io/betolink; my proof: https://keybase.io/betolink/sigs/azote6CadLDSHSvgcYeTlITrXz-HkQD6jwlG3JkoQGM ]
Exactly, language is just the name we give these events when they are represented using a symbolic system.
..and medium-sized/small sites are even worse.
The irony of Facebook being a core part of all NSA surveillance programs and their terms of service including their "Automated Data Collection Terms" https://www.facebook.com/apps/site_scraping_tos_terms.php
I mean the hypocrisy level is off the charts!
Another thing we noticed is that google's crawler is kind of aggressive, I guess they are in a position to do it.
Our paper in case someone is interested: Optimizing Apache Nutch for domain specific crawling at large scale (http://ieeexplore.ieee.org/document/7363976/?arnumber=736397...)
There are concrete issues that can be addressed by electing certain persons but generally speaking, change and elections(especially with money involved) it's like the traffic buttons... you think the light changed because you pressed it.
The problem with today's mainstream media is that they don't talk a lot about the big issues but those outliers. If we focus on the things that matter well yes we're not in the middle ages but we're not in the best shape possible as a civilization.
dbpedia is a triple-store that allows us to perform simple queries against wikipedia data like listing music bands based on a particular city:
SELECT ?name ?place
WHERE {
?place rdfs:label "Denver"@en .
?band dbo:hometown ?place .
?band rdf:type dbo:Band .
?band rdfs:label ?name .
FILTER langMatches(lang(?name),'en')
}
or queries that involve multiple subjects, categories etc.Knowledge representation is still one of the main bottlenecks on AI/ML in general, a deep learning network is not going to prepare its food by itself.
I think you got this wrong, Facebook is not the target, their users are. Which reminded me of "If a service on the Internet is free, you are the product"
So crawling a billion of links in X number of hours is not trivial but not that hard specially with cloud infrastructure like AWS, it's just a matter of a good enough implementation and how much money one wants to spend on it.