kami8845

Quite a perverse strawman from someone who just a second ago asserted what "this discussion is about".

Who would you personally feel more comfortable lending money to, a complete stranger (who might very well need it more -- aka optimal distribution of resources) or someone within your family or close circle of friends, where you have some level of confidence that they will simply run off with your money or squander it?

If you actually felt sorry you should probably delete that trash post of yours.

>Elizabeth Holmes' ability to raise money also seemed to be based entirely on nepotism.

Right, she should've rejected that money, it would only be fair if it was as hard for her as it is for us.

Why is it important that she has connections? Does being upset about that help you in any way?

Sorry, I'm really jaded about this kind of victim mentality. Ignore what advantages others have and build your tower as high as you can.

Haha, what specifically are you talking about?

Hmm, I'll have to investigate that, any tips for libraries to use for validation that tie well into scrapy?

What do you do if you discover that your parsing logic needs to be changed after you've scraped a few thousand items? Re-run your spiders on the URLs that raised errors?

Microdata is indeed awesome but it's not always there. One website had location tags for me to extract from 97% of pages. Except for a few where the <meta> tags were just missing. Wound up using AlchemyAPI's entity extraction to try and get the location out of the text that way.

Thanks for the blogpost! I actually did not know about any of the 3 libraries and am gonna start using them.

I love ScrapingHub (and use them) but these tips go completely against my own experience.

Whenever I've tried to extract data like that inside Spiders I would invariably (and 50,000 URLs later) come to the realization that my .parse() ing code did not cover some weird edge case on the scraped resource and that all data extracted was now basically untrustworthy and worthless. How to re-run all that with more robust logic? Re-start from URL #1

The only solution I've found is to completely de-couple scraping from parsing. parse() captures the url, the response body, request and response headers and then runs with the loot.

Once you've secured it though, these libraries look great.

PS: If you haven't used ScrapingHub you definitely should give it a try, they let you use their awesome & finely-tuned infrastructure completely for free. One of my first spiders ran for 180,000 pages and 50,000 items extracted for $0.

What you're saying goes against a lot of research into how humans pick partners. [0][1] It's very complex and little of it is conscious.

[0] https://en.wikipedia.org/wiki/Sexual_selection_in_humans

[1] https://en.wikipedia.org/wiki/Assortative_mating#Assortative...

This made my day, not only are people offering much-needed advice (3 years .... this is so painful to read), you're actually offering a free redesign. Thanks for this (because apparently OP is too busy defending his bad decisions)

Thanks for posting this, can't believe it only has 10k views.

> multi decade slave train

If you want to have "made it", go start a startup. Being an employee generally means working 40-60 hour weeks for other people's dreams.

It's still a market if every product is free. And they're not even really free, you pay with potential advertising revenue, vendor lock-in and with data that you generate.

Submit your specs TODAY and our "top 1% engineers" will deliver in just 30 days!!

The article is talking about working with dev studios & outsourcing large-ish projects.

If you're a singular developer charging a flat hourly rate (I am too), yes posting on the web will likely fulfill your needs.

If you're a dev studio looking for your next $50,000 project, probably not.

For a native speaker the first meaning may be a bit of a stretch (if I was trying to communicate that I'd word it differently), but technically, yes.

At this point I feel it'd be fair to make heavy revisions to the blog post.

One must think, if you really were the expert you position yourself to be, you should've been able to talk to at least ONE person working in a BIG4 before putting your name underneath it all?

Well that just nostalgia'd me hard

Thanks this is super useful :)

Easily?

You don't think the wife would've seen the husband enter his passcode in front of her at least once?

If you go to the London hipster map. I live square dead in the middle of it (the Shoreditch triangle). Granted I've only lived here for 4 months but the only 2 bad things that I've seen were:

1) Someone puked in the alleyway that leads to my door. I walked around it. 2) One day when coming home at 11pm, there were people smoking weed in front of my door and one guy was pissing against the building close to my door. I went inside and everyone minded their own business.

Yeah those are not the nicest of experiences, however I'm rewarded every day by incredible access to art & culture (and amazing music gigs I can walk to by foot) and -- plainly -- I love people who step outside normalcy in terms of how they dress & express themselves. It's fun to see and makes me push my own boundaries :)

EDIT: Shoreditch is by now also an incredibly safe & affluent/expensive area. Never once have I felt threatened here, I feel safe carrying my phone on me at all times of day/night. This might be different in the cheaper-but-also-hipster areas of Hackney like Dalston.

You can save yourself trying to guess how to navigate a page and simply use page up / page down :) It's also faster that way.

Fellow Austrian here. I was in your exact boat about 6 months ago. Startup "scene" in Vienna is sad. Immigrating into the US is hard so I looked at Berlin and London.

For now I'm living in London. I considered Berlin, but I think the English practice here is invaluable. My English was already quite good when I came here, but it's improved LOADS. Also there's much more going on in general (culturally, socially), and there's more and bigger startups here (e.g. compare HN Who's hiring / startup city rankings).

Isn't GAE like ... long dead? Who would still trust them with a new project at this point in time?

Why is it OK to be rude through abbreviations?

You'd get heavily downvoted for asking "Did Peter Norvig not read the fucking article?", yet that's exactly what you've put into everyone's mind with your comment.

>Also, named tuples are profoundly more useful (i.e. using them is one of the easiest ways to improve the clarity of your code).

I read that and I thought, "that's such a thing Raymond Hettinger would say". Then I glanced up at the username :)

Why learn from the guy who made the mistakes when you can learn from the guy who didn't?

Don't see this as me putting you down. I just wish people started working on the next generation of group chat (which is a HUGE field) rather than just piling more of the same on top of old stuff.

I don't want IRC. I want HipChat (inline images, ability to directly upload & share media, persistence, good searching, integrated video, HTTP API) but with non-shit native clients. IRC is a fucking dinosaur, I feel something like this doesn't have the capability to really improve the situation.