HNHacker News
TopNewBestAskShowJobs

betolink

2,597 karma · joined September 17, 2013

"We must know — we will know"- David Hilbert

Twitter: @betolink

https://keybase.io/betolink

[ my public key: https://keybase.io/betolink; my proof: https://keybase.io/betolink/sigs/azote6CadLDSHSvgcYeTlITrXz-HkQD6jwlG3JkoQGM ]

submissionscomments
betolink··on Facebook Backs Down on Censoring ‘Napalm Girl’ Photo
Can Facebook be held accountable under monopoly laws? They are too big and too influential for our own good.
betolink··on People from Mexico show stunning amount of genetic diversity
I remember a little while ago my dad went to an academic lunch with Dr. Craig Venter in Chiapas (MX), he was talking about sampling DNA from the Americas to register genes that could potentially help medical research and are endemic to the region.
betolink··on Evidence Rebuts Chomsky's Theory of Language Learning
> It's an underlying structure that helps organize concepts. Who says thinking in shapes or concepts is not a language?

Exactly, language is just the name we give these events when they are represented using a symbolic system.

betolink··on A Russian Family Was Isolated for 40 Years, Unaware of WWII (2013)
you got it.
betolink··on A Russian Family Was Isolated for 40 Years, Unaware of WWII (2013)
I'm a fan of these videos! if I get stranded on an Island my only hope is to have enough battery and this guy's videos on a usb drive =)
betolink··on How to Crawl the Web Politely with Scrapy
What about https://www.facebook.com/robots.txt

..and medium-sized/small sites are even worse.

The irony of Facebook being a core part of all NSA surveillance programs and their terms of service including their "Automated Data Collection Terms" https://www.facebook.com/apps/site_scraping_tos_terms.php

betolink··on EpiPen CEO: Blame the 'broken' system, not me
"This system needs to be fixed. No one knows what anything costs," Heather Bresch, the Mylan CEO.

I mean the hypocrisy level is off the charts!

betolink··on How to Crawl the Web Politely with Scrapy
I worked on a research project to develop a web-scale "google" for scientific data and we found very interesting things on robots.txt, from "don't crawl us" to "crawl 1 page every other day" or even better "don't crawl unless you're google".

Another thing we noticed is that google's crawler is kind of aggressive, I guess they are in a position to do it.

Our paper in case someone is interested: Optimizing Apache Nutch for domain specific crawling at large scale (http://ieeexplore.ieee.org/document/7363976/?arnumber=736397...)

betolink··on A Soccer Con Man Who Couldn't Play the Game
I totally see this not only in the startup scene but life in general! in every trade there is a charlatan that will fake mastery of the skills needed to succeed.
betolink··on Everyday ‘Placebo Buttons’ Create Semblance of Control
I have gay friends and most of them agree, what about trying telling that to a poor person? elections are -on its current form- a very unrepresentative way of democracy.

There are concrete issues that can be addressed by electing certain persons but generally speaking, change and elections(especially with money involved) it's like the traffic buttons... you think the light changed because you pressed it.

betolink··on Everyday ‘Placebo Buttons’ Create Semblance of Control
Election after election, the ones in our voting machines are the ultimate placebo buttons.
betolink··on Pinker: “News is a misleading way to understand the world”
well, IMO news should also cover the issues that affect the masses, yes, an accident in a refinery is an outlier but a vote on carbon taxes in congress is something that affect us all.

The problem with today's mainstream media is that they don't talk a lot about the big issues but those outliers. If we focus on the things that matter well yes we're not in the middle ages but we're not in the best shape possible as a civilization.

betolink··on Extracting data from Wikipedia using curl, grep, cut and other bash commands
It's not surprising that Phelps is not on the list, you're grouping by ?human and he is not... jk, maybe there is an ontology issue i.e. new triples are using a different class or that triple-store is not up to date.
betolink··on Extracting data from Wikipedia using curl, grep, cut and other bash commands
...or we can just use SPARQL and dbpedia!(http://wiki.dbpedia.org/) There are questions where you'll have to scrap more than one page to get an answer and things could get really complicated with shell commands.

dbpedia is a triple-store that allows us to perform simple queries against wikipedia data like listing music bands based on a particular city:

  SELECT ?name ?place
  WHERE {
    ?place rdfs:label "Denver"@en .
    ?band dbo:hometown ?place .
    ?band rdf:type dbo:Band .
    ?band rdfs:label ?name .
    FILTER langMatches(lang(?name),'en')
  }
or queries that involve multiple subjects, categories etc.
betolink··on Salesforce buys word processing app Quip for $750M
$750M for a word processing app? Go home Silicon Valley you're drunk!
betolink··on When a crow dies, the other crows investigate the cause of death (2015)
"...Afterward the birds ignored the harmless Cheneys" No such a thing as a harmless Dick Cheney.
betolink··on Simple questions to help reduce AI hype
One question that's not explicitly asked on this list: How much preparation does the training data need?

Knowledge representation is still one of the main bottlenecks on AI/ML in general, a deep learning network is not going to prepare its food by itself.

betolink··on Google's My Activity reveals just how much it knows about you
Now add all the other sites we use on a daily basis. The scary thing is that most of us don't care, we are happy giving up our data in exchange for these services.
betolink··on Microsoft and Canonical partner to bring Ubuntu to Windows 10
Once upon a time Steve Ballmer said that GPL/Linux was cancer, it's odd to see his company spreading it =)
betolink··on Tools for thought: graphical algebra and Fourier analysis
This is exactly how Math should be explained, connecting the dots between abstractions and the real world! beautifully done!
betolink··on Common Search – nonprofit search engine for the Web
Totally on point, if privacy is a concern the company should not be inc. on American soil. I'm also having a hard time trying to find the roadmap for infrastructure, how many machines are running or will be expected to run. Scaling is not trivial and I don't see how that would be addressed.
betolink··on How I could have hacked any Facebook account
> Facebook is not a high value target, relatively speaking.

I think you got this wrong, Facebook is not the target, their users are. Which reminded me of "If a service on the Internet is free, you are the product"

betolink··on Feynman’s proof of the Maxwell equations
I was lucky enough of having a good math teacher that understood and taught Lorentz and Einstein equations, he used to say "Once that you get it, you will laugh at them", here I am several years later still waiting for some of those laughs.
betolink··on The alarming threat of Zika virus
Yes, I live in Chiapas and we have confirmed cases already.
betolink··on The alarming threat of Zika virus
Correct, not everybody can do significant contributions to say molecular biology. My point is that we need more smart people working on the problems that matter and right now we have a lot of smart people working on http://(buzzwords).io
betolink··on The alarming threat of Zika virus
This is getting serious here in southern Mexico, we just had a chikungunya outbreak a year ago and now this. These situations remind me of a talk given at Oscon Data by Steve Yegge about working on the things that matter[0]. Virus are complex and modelling molecular biology requires CS expertise, it's kind of sad that we're normally discussing the new JS frameworks instead of working on the hard(and important)problems.

[0] https://www.youtube.com/watch?v=vKmQW_Nkfk8

betolink··on [dead]
Ha! yup I'll delete this one, didn't know that it was already posted...
betolink··on YouTube change served lower-quality video to Firefox 43 for 2 weeks
I've also noticed the bug, it didn't happen with Chrome. What do you all think was my first thought?
betolink··on How to crawl a quarter billion webpages in 40 hours (2012)
I've been working on something similar and I have ran into some of the issues you mention. As you correctly pointed out, quality and post processing is also relevant to not crawl irrelevant/spam sites, which can be HUGE! The work presented here is cool but it does not address the whole picture. Having a crawler that takes quality and user feedback into account is the hard part. Not to mention if you are being polite with the requests... we need to scale but not ignoring Robots.txt

So crawling a billion of links in X number of hours is not trivial but not that hard specially with cloud infrastructure like AWS, it's just a matter of a good enough implementation and how much money one wants to spend on it.

betolink··on The “Anyone but Richard M Stallman” (ABRMS) License
This is a stupid "license"... I rather like the "DO WHAT THE FUCK YOU WANT TO PUBLIC LICENSE" that I use from time to time https://github.com/betolink/snowgl > http://www.wtfpl.net/txt/copying/
← PreviousPage 3 of 4Next →