bootcat

Thanks , great info !

I think the questions are too opinionated !

A similar question i asked, got good responses. https://news.ycombinator.com/item?id=14290025 . But i have the same question and thought too.

Have you tried Dalmatein and TsDB ?

I absolutely agree, and I am thinking strategies to even automate the capatcha, using crowdsourcing or better, using AI/ML ( which is not trivial ).

duckduckgo is good but not there yet.

Would you be interested to work on a search engine ? Some projects are bitfunnel and so forth.

One of the important avenues to scrape AJAX heavy and phantomjs avoiding websites is using the google chrome extension support. They can mirror the dom and send it to an external server for processing where we can use python lxml to xpath to appropriate nodes. This worked for me to scrape Google, before we hit the capatcha. If anyone is interested, i can share code i wrote to scrape websites !

If you can scrape findthecompany database ? I have done it successfully !!

I have also used Mathematical monk, who was simple and good in introducing basic concepts and tools related to ML. https://www.youtube.com/user/mathematicalmonk

Certainly its worth taking a look at another javascript library which works for fuzzy search called, fuse, http://fusejs.io/.

I have the same questions, but to my surprise, there are more software engineer/senior software engineer jobs in bay area than data scientist/machine learning engineer, according to LinkedIN. This is the scenario now ! No idea hows its going to be in 3-5 years from now !!

Another library worth mentioning is https://github.com/h2o/h2o

I think this project is similar to http://www.craftinginterpreters.com/

I think they should really make the project in sync with cpython. Because already they have a huge gain, for pythonic stuff.

Really worthy insight. Especially for people like me, who wants to get a deeper understanding of the ecosystem before being an actual data scientist !

Guys, I was thinking to do something like this, and you guys have already made it. Looks good. Will use and give you more updates !

Yoga and Hinduism have always been preaching this. The universe and for that matter, even a stone is a living entity. There is a higher cosmic intelligence and consciousness that is capable of taking macro/micro decisions.

Simple and nice article !!

godsend !!

I think jotting down very important points we realized while developing is worth noting down. May be in a gitbook. But having an actual paper or notepad journal and noting down everyday things is too much data and we rarely, and i mean like very rarely look at that a second time !

Guys, i just started reading through source code of 8cc and now this new project :). https://github.com/rui314/8cc

Thank you, really good read and great product idea !!

yes, I am interested in them too. Usually the hype was for big data, then it moved to IOT, and now in AI. Seemingly seeing where it would go next !!

If Microsoft can't make things happen, I am not sure who can ! They have money, influence, power and user base with personal computers and cloud, and still they failed !

Wanted to do something similar for so long !! I am also interested if you do ajax sites, and if so how ?

Nice coverage !! For some reason they don't offer a one click pdf and its bit difficult to navigate !

Really good read ! Must read for people who like algorithms and competitive programming !

Once they said Jeff is the worst CEO alive !!, now things are getting a change !

wow !! unsure if that's actually true.

doesn't http://www.builtwith.com/ do this already and have so much data too ?

Actually, that seems to be right from my limited experience. Also, my yoga guru says, being selfish is also good at times, because we are responsible for the life that we are first, and then comes other lives.