wc-

What is your plan for long term profitability if you have no plans to charge for this? I am nervous building tech around a free service that may either transition to a deal-breaking price (google app engine) or may disappear entirely due to the business going under.

Uber has lots of non-millenial users. Millenials do make up a large percentage of the userbase, but I would argue that has more to do with the age breakdown of urban workforce populations. There are larger forces at play here: younger workforce is moving to urban areas, not suburbs, and this is impacting car ownership because cars are not needed in many urban environments.

For reference, here is a breakdown of Uber's customer base in the US: http://www.globalwebindex.net/blog/the-demographics-of-ubers...

I'm having a hard time justifying the effort spent to respond to this comment, it seems very low quality...

PositiveEV - Using the latest and greatest in analytics, machine learning, and game simulation techniques to predict sports teams' performance. Hard work with big payoffs, reach out to me if you are interested and think you have something to contribute.

Digital H2O | Chicago, IL | http://www.digitalh2o.com/ | Full Time | ONSITE or REMOTE

Digital H2O, a water-focused SaaS company, is looking for talented software engineers to join us in building products to solve the challenge of sustainably managing, monitoring, and forecasting water supply and demand in cost-effective ways.

Digital H2O offers an agile work environment where you can have a large impact on the direction and success of the company. As a Senior Software Engineer you are given the opportunity to own products and features from start to finish, design to delivery, using the best tools for the job at hand. In return we offer a competitive salary, full health benefits, 401K matching, annual bonuses, relocation assistance, a generous paid vacation policy, and more.

There are many products a Senior Software Engineer has the opportunity to help us build, including:

  - Our water market intelligence platform using Python, MongoDB, Pandas, AWS, and more to build a comprehensive view into the world of water demand and supply
  - Water forecasting and modeling analytics using Python, Scikit-Learn, and proprietary machine learning techniques
  - Customer-facing Data APIs powered by NodeJS, Python, PostgreSQL, and AWS
  - Platform designed for receiving and analyzing real-time industrial water data from  field deployed remote monitoring sensors
  - New products from the ground up

A strong fit for this position will have most of the following:

  - Significant software development experience and language familiarity (Python is our primary language but we believe talented engineers can quickly learn new languages)
  - Comfort and familiarity with at least one SQL or NoSQL database
  - Experience with developing and consuming web services and SaaS products
  - Strong collaboration and communication skills to work in a fast-paced, entrepreneurial environment

Other things we would love to see:

  - 3+ years professional experience
  - Experience scaling data and infrastructure to one, to ten, to hundreds of terabytes, and beyond
  - Familiarity with Amazon AWS
  - A love of Pandas, NumPy and other Python data packages
  - A degree in computer science, statistics, environmental science, or related STEM field
  - An ambition for solving complex problems while working both autonomously and with a team

Email wcleveland ( a t ) digitalh2o.com to apply!

Digital H2O | Chicago, IL | http://www.digitalh2o.com/ | Full Time | ONSITE

Digital H2O, a water-focused SaaS company, is looking for talented software engineers to join us in building products to solve the challenge of sustainably managing, monitoring, and forecasting water supply and demand in cost-effective ways.

Digital H2O offers an agile work environment where you can have a large impact on the direction and success of the company. As a Senior Software Engineer you are given the opportunity to own products and features from start to finish, design to delivery, using the best tools for the job at hand. In return we offer a competitive salary, full health benefits, 401K matching, annual bonuses, relocation assistance, a generous paid vacation policy, and more.

There are many products a Senior Software Engineer has the opportunity to help us build, including:

  - Our water market intelligence platform using Python, MongoDB, Pandas, AWS, and more to build a comprehensive view into the world of water demand and supply

  - Water forecasting and modeling analytics using Python, Scikit-Learn, and proprietary machine learning techniques

  - Customer-facing Data APIs powered by NodeJS, Python, PostgreSQL, and AWS

  - Platform designed for receiving and analyzing real-time industrial water data from  field deployed remote monitoring sensors

  - New products from the ground up

A strong fit for this position will have most of the following:

  - Significant software development experience and language familiarity (Python is our primary language but we believe talented engineers can quickly learn new languages)

  - Comfort and familiarity with at least one SQL or NoSQL database

  - Experience with developing and consuming web services and SaaS products

  - Strong collaboration and communication skills to work in a fast-paced, entrepreneurial environment

Other things we would love to see:

  - 3+ years professional experience

  - Experience scaling data and infrastructure to one, to ten, to hundreds of terabytes, and beyond

  - Familiarity with Amazon AWS

  - A love of Pandas, NumPy and other Python data packages

  - A degree in computer science, statistics, environmental science, or related STEM field

  - An ambition for solving complex problems while working both autonomously and with a team

Email wcleveland ( a t ) digitalh2o.com to apply!

Digital H2O | Chicago, IL | http://www.digitalh2o.com/ | Full Time | ONSITE

Digital H2O aims to build products that enable cost effective and sustainable use of water in industrial processes. We use a strong mix of data engineering and machine learning to forecast the oil and gas marketplace.

- Data Platform Engineer | Seeking an engineer with strong experience in Python and a love of gaining new insight from data using tools like Pandas, SciKit-Learn, and much more.

Given our small team size you will have a meaningful impact from the start. We have the monetary backing of a large company so we are able to offer market-to-above-market pay, your choice of laptop and multiple vertical or horizontal monitors, 401k matching, annual bonus, great health plans, and more. Contact wcleveland (at) digitalh2o.com or visit http://www.digitalh2o.com/careers for more info.

Digital H2O | Chicago, IL | http://www.digitalh2o.com/ | Full Time | Onsite

Digital H2O aims to build products that enable cost effective and sustainable use of water in industrial processes. We use a strong mix of data engineering and machine learning to forecast the oil and gas marketplace.

- Senior Front-End Engineer | Seeking an engineer with strong experience in building single page applications in a modern framework. We currently use Ember but strong experience with any of the popular frameworks would be great.

- Senior Data Engineer | Seeking an engineer with strong experience in Python and a love of gaining new insight from data using tools like Pandas, SciKit-Learn, and much more.

We offer market-to-above-market pay, your choice of laptop and multiple vertical or horizontal monitors, 401k matching, annual bonus + biannual review, and more. Contact wcleveland@digitalh2o.com or visit http://www.digitalh2o.com/careers for more info!

I've enjoyed working with Hired.com from the POV of the employer doing the hiring.

Unfortunately it's been caught up in the classic proprietary closed-source vs public source political debates... Pretty much zero chance anything we do gets added to the public domain.

If you are into baseball and advanced sabermetric stats, there's a bunch of c3.8XL and g2.8XL instances out there cranking through data to train various neural networks. The results can't be published to the public but I'd be happy to add you to the distribution list of results and future projections.

Digital H2O | Chicago, IL | http://www.digitalh2o.com/ | Full Time | Onsite

Digital H2O aims to build products that enable cost effective and sustainable use of water in industrial processes. We use a strong mix of data engineering and machine learning to forecast the oil and gas marketplace.

- Senior Front-End Engineer | Seeking an engineer with strong experience in building single page applications in a modern framework. We currently use Ember but strong experience with any of the popular frameworks would be great.

- Senior Data Engineer | Seeking an engineer with strong experience in Python and a love of gaining new insight from data using tools like Pandas, SciKit-Learn, and much more.

We are building out a small and experienced team and at this time are only looking for the most experienced and proven teammates we can find. We offer very-competitive-to-above-market pay, your choice of laptop and multiple monitors, 401k matching, annual bonus + biannual review, and more. Contact wcleveland@digitalh2o.com or visit http://www.digitalh2o.com/careers for more info!

There's a python package called dex (https://github.com/mongolab/dex) that helps assist with index recommendations by looking at mongo's oplog and query response times. It's not perfect but better than nothing for alerting people to a missing index. Unfortunately I think it is not under active development anymore and beginning to fall behind with changes in mongodb.

I've had a lot of sucess using a key in redis with a TTL value instead of a local PID file. Although adding redis to the picture adds a large new point of failure, I can then have a cronjob set up on multiple instances and still ensure it only runs once across all of them.

I'm sure there is a simpler way of doing this, how have other people solved redundantly ensuring a single cronjob runs?

Chicago, IL - Digital H2O - http://www.digitalh2o.com/ - Full Time - No Remote

- Senior Front-End Engineer | Seeking an engineer with strong experience in building single page applications in a modern framework - such as Ember.js, AngularJS or Backbone.js

- Senior Data Platform Engineer | Seeking an engineer with strong experience in Python and a love of gaining new insight from data.

Contact jobs+hn@digitalh2o.com or visit http://www.digitalh2o.com/careers for more info!

Digital H2O (http://digitalh2o.com) - Chicago Full time Front End Engineer

We're looking for software engineers to join us building applications to solve the challenge of cost-effectively and sustainably managing oilfield water. We believe passionately in the “win-win”; world-class data analysis, combined with software and marketplace mechanisms, can help our society solve challenging natural resource and environmental problems.

As our primary/senior front-end developer you will have the enormous opportunity to join a founding team and develop a system from the ground up.

Highlights from our tech stack: AWS, Ember, SASS, MongoDB, NodeJS, Python

Key Responsibilities and Requirements:

  - Strong javascript skills, especially development of single page applications using ember, angular, react, etc.
  - Work on an agile engineering team to build new products and features from the ground up
  - Participate in planning, architecture, design, implementation and maintenance of features
  - Graceful degradation, progressive enhancement

Immediate need is for a front-end developer, but we are also interested in growing our devops and backend / data engineering staff, as well as continuing to grow our data science team.

Email: contact+hnhiring@digitalh2o.com

Even from the POV of the interviewer it's a great question. I'd give my answer then brainstorm with the interviewee about how they would propose solving that problem.

Would you feel comfortable asking an interviewee the same question about their last job? It could give a sense of how they think / why they are looking for a new spot but might be a little invasive.

Digital H2O (digitalh2o.com) - Chicago Full time Front End Engineer

We're looking for software engineers to join us building applications to solve the challenge of cost-effectively and sustainably managing oilfield water. We believe passionately in the “win-win”; world-class data analysis, combined with software and marketplace mechanisms, can help our society solve challenging natural resource and environmental problems.

As our primary front-end developer you will have the enormous opportunity to join a founding team and develop a system from the ground up.

Our TLDR tech stack: AWS, Ember, SASS, MongoDB, NodeJS, Python

Key Responsibilities and Bonus Points:

  - Can work in a variety of languages and systems (we use a mix of JavaScript, Node.js, Ember.js, SASS and CSS)
  - Work on an Agile engineering team to build new products and features from the ground up
  - Participate in planning, architecture, design, implementation and maintenance of features
  - Graceful degradation, progressive enhancement

Immediate need is for a front-end developer, but we are also interested in growing our devops and backend / data engineering staff.

Email: contact+hnhiring@digitalh2o.com

Looks pretty cool, looking forward to playing around with it.

How does this compare to celery w/ rate limiting of individual tasks? Celery can be pretty daunting (heavyweight perhaps?) sometimes, having a simpler alternative could be useful. However, I wonder if by the time you need rate limiting of queues, you will probably need additional "heavy" features as well.

I'd love to see a deeper comparison of sharq's usage of redis vs celery's. For example, are there any performance gains by using sharq's lua commands or schemas vs celery's?

There are a few typo's in the features section btw (minmal, seriazlied).

Check out Mechanize: https://github.com/sparklemotion/mechanize

I haven't used the ruby version but I am pretty happy with the python port of it. It's lighter and faster than phantom, but it won't do javascript interpretation.

Selenium seems very heavy-weight to me (granted I have only used selenium server). If you don't need to interpret javascript after a page loads then you might be able to use mechanize. In my experience I've gotten better performance and a higher ease of development with mechanize over selenium or other "full" headless browsers. Different tools for different jobs I suppose, I just tend to go for the smallest tool first.

edit: replace mechanize with mechanicalsoup in the above paragraph, they are aiming to solve the same problems in the same way.

Right, python's mechanize at https://github.com/jjlee/mechanize seems to be pretty stagnant.

Mechanize is a core part in quite a few of my projects lately and the fact that it hasn't been modified in over 2 years has been very worrisome.

There are lots of edge cases out there on websites. Mechanize has built up years of fixes and workarounds for these, I hope that MechanicalSoup can learn from these the easy way rather than waiting to make the same mistakes again.

I also hope that this repo grows into a bigger community of support, not just one person contributing (who could leave / get bored at any time). Looking forward to following this!

This seems like a nice layer between some data scientists that might be used to working with csv's or some subset of databases, and a dev team that happens to be using another subset of db's. Data scientists could throw some results into a csv and front end devs could quickly pull it in as a rough version of what the actual API would look like to get started on presentation of the data. First pass mockups could be done taking minimal time away from the engineering team, iterate these with stakeholders, and finally implement the final API with the fully fleshed out front end.

I know rust is pre-1.0 but wow that's a lot more breaking changes than I expected...

This looks very nice. I've been following rust and go for a while now and I finally have a small service to write that would be a good fit for either language so I'm going to try both.

I noticed one of the repo's more recent issues was caused by a change upstream. The upstream rust devs seem very accessible, but how often do you encounter these kinds of breaking changes. Acknowledging that rust is pre-1.0, is there any way to stay up to date on these kinds of changes before they hit your app so you aren't blind sided?

I was disappointed to not see integration with pivotal tracker.

Maybe it would be too duplicative since pivotal is supposed to show what is being worked on at a glance, but this integration was the one thing I was hoping to try out in the free plan after viewing the landing page...

Blog seems to be down for me now, cached entry here: https://webcache.googleusercontent.com/search?q=cache:y92P5i...

I'd imagine people have been charged with crimes for much less than what one could attempt to charge this author with if some scriptkid uses this code and causes damages.

I respect the author for wanting to be a part of the community contributing code related to this event but some self-preservation might be in order...

You will definitely have downtime due to hardware issues with AWS as well, and every other host out there... Maybe it would be better to spend the time you were going to spend switching to AWS investigating a load balancing setup and other things you would need to remove the dependency on one instance always working correctly?

The flexibility of the cloud is awesome but sometimes it does get cloudy up there. Redundancy is a must with digitalocean, aws, or anyone else.

Despite all the controversy, soylent did show there is a market for this. If MealSquare can actually deliver to early adopters in a timely fashion, I'd imagine they could capture a lot of the Soylent market...

Looking forward to the crowdfunding and more timeline details!