71 karma · joined May 6, 2016
The single interface for any cloud GPU is cool, but hard to imagine it taking off without some additional features.
I think for lots of shops the hardest part isn't the compute but moving the data around. Ie for us, we use s3, some lustre caching and spot instance nodegroups. We are a deep learning research team that spends roughly 40-50k/month on aws compute for training jobs. I imagine this is somewhat mid tier, maybe more than some but certainly far less than others.
For inference, data egress costs could be less of an issue, but your service would really need to be almost invisible. It probably would be pretty complicated for a number of reasons, but if you could design a "virtual on-demand nodegroup"™ that I could add to my existing clusters and then map to whatever k8s stuff I want, that would probably be useful. I would need to be able to auto deploy a base image to the machine and then provision the node and register with my cluster.
Just some unorganized thoughts. Good luck and have fun.
Radiant Earth Foundation's core mission is to make insights from remote sensing data and machine learning an order of magnitude more accessible for global non-profits, humanitarian organizations, emerging economy governments, and others. https://radiant.earth
We provide a free platform that takes care of all of the geospatial processing and machine learning so that users with any level of remote sensing experience, from zero to expert, can use near real-time data to get geospatial insights for their use case.
In addition to our platform, we work with organizations on complex use cases with high-impact outcomes. Since our founding in 2016, we've worked with the Bill and Melinda Gates Foundation (a primary funder), the Omidyar Network (another primary funder), as well as the United Nations Institute for Training and Research, Schmidt Futures, the World Bank and more.
We work with a range of fellows and contractors to support our efforts, but our in-house engineering/ML team is just 2 people :) In addition to being somebody who is excited to be part of a small team working on large-scale problems (right now we're all generalists, to an extent), we're especially interested in applicants who want to help us foster a team culture of respect, inclusion, and diversity.
Apply here: https://bit.ly/2CLLzdK
If you have any questions, please don't hesitate to shoot me an email: alando (at) radiant.earth
You can use the search tool without being a member or qualifying for the reduced rate sessions. Really useful for those in the U.S.
If we have someone check our teeth and gums a couple times a year just to clean out the gunk and make sure everything is ok, why wouldn't we do the same for our (arguably) most important organ?
I'd consider taking a short break from programming if I were you. Why not get a temporary job as a river guide or something outdoors? Maybe go on a long backpacking trip or do some other kind of adventure. After getting crushed by years of corporate culture, I'm sure your soul could use a little fun and adventure to reinvigorate and recharge itself! In my experience, (I'm a software engineer engineer) the perspective gained from taking a temporary break and trying something completely different (that maybe puts you a little out of your comfort zone) can drastically improve overall confidence/happiness/wellbeing much more than any minor resume addition. Take a moment to emotionally regroup before you charge back into career life!
Seek adventure!
Sms Lists is an sms craigslist for refugee camps. I made it after visiting a couple of refugee camps and realizing that it was really hard for business owners who made <$1/day to have any extra money left over to re-invest in marketing their businesses. Code is here: https://github.com/alando46/smslists