HNHacker News
TopNewBestAskShowJobs

exhaze

817 karma · joined July 2, 2009

submissionscomments
exhaze··on Facebook senior software engineer interview
Hey, someone's gotta paint the roses red.
exhaze··on Slack is down
> run it in a beta environment

Every Uber/ex-Uber engineer is nervously chuckling at this comment right now

exhaze··on Slack is down
I haven't worked at Slack, so I can't speak with high confidence. A traffic spike is a possible reason, but I'm willing to bet that it's not the reason:

> Doubt anyone releasing big changes Monday morning.

This is definitely an engineering best practice, and by best practice, I mean something that Uber's, I mean Slack's SRE team strongly pushed for, and got politely overruled on. After a code freeze is lifted, it's quite common for lots of promotion-eager engineers to release big changes.

exhaze··on Slack is down
To elaborate a bit more on this point, you have to think about it like any complex system failure - it's almost never one thing, but rather a combination of many different factors. The factors around post NYE releases:

- high risk changes that weren't released pre-holidays get released. Depending on the company, this could mean a 1-week to 1-month delay between implementation and release. The greater that interval, the higher the divergence world of production and the world of the new feature

- lots of new hires (new year = new hiring budget). New hires are missing some tribal knowledge about the system and make a production-breaking release.

I tried to think of other reasons, but these two overwhelmingly stand out as the two biggest reasons. Would love to hear from others.

exhaze··on Slack is down
When I was at Uber, we noticed that most incidents are directly caused by human actions that modify the state of the system. Therefore, a large "backlog" of human actions that modify the system state have a much higher chance of causing an incident.

My bet is that this incident is caused by a big release after a post-holiday "code freeze".

exhaze··on Google outage – resolved
Seems like the incident lasted from 04:00 AM PST to 04:30 AM PST, at least for BigQuery (sorry, image timestamps are in JST, since I'm in Japan): https://imgur.com/a/kiHED6v
exhaze··on Heavy is the Head that wears the AirPods Max
I'm aware how people on this site think about products like this. Can you tell me why, despite the strong sentiment here, the product is still so popular?
exhaze··on Heavy is the Head that wears the AirPods Max
Can you respond to me by clearly stating your point?
exhaze··on Heavy is the Head that wears the AirPods Max
Do you really believe this so strongly that you write this strongly-worded comment?

Plenty of reasons why people would convince themselves to buy them:

- I can easily return it if I don't like it (most never do)

- the OS X/iOS integration will be way better than my current headphones (my poison)

- I love Apple

- 2020 sucked, if I can't even go to Thailand this year, I'll at least treat myself to these. I deserve it.

exhaze··on Boeing cuts flight training pilots, will outsource jobs overseas
Can you explain specifically what you makes you think that there will be heavy demand for travel, based on some facts?
exhaze··on AresDB: Uber's GPU-Powered Open Source, Real-Time Analytics Engine
Hey, at least you didn't have to use TChannel and Hyperbahn ;)
exhaze··on Game Programming Patterns: Event Queue (2014)
Can you give more context about your projects i.e. what makes them require a super high-performance queue?
exhaze··on The 212-story skyscraper in Melbourne, Australia
Not #1 but definitely at the top of HN on that day :) https://news.ycombinator.com/front?day=2007-11-28
exhaze··on Dependency
The most newsworthy one in the last year was core js - a JS poly fill library that most other big npm libraries are built on top of. The maintainer is some random guy from a remote part of Russia. About half a year ago, he was sentenced to a prison sentence . He was the sole maintainer of the project (I guess he refused to give other people write access). I’m not sure if any of its dependent projects have done anything about forking the project, but I wouldn’t be surprised if most just ignore it until it causes some hilarious left-padpocalyse.
exhaze··on Uber and Lyft ordered by California judge to classify drivers as employees
Uber has been rolling out a feature to allow drivers in California to set their own prices, and today rolled it out to the entire state. https://www.independent.co.uk/news/world/americas/uber-calif...
exhaze··on An Email got us $5k in AWS Credits
I can't think of any other company that bends over backwards to please engineers who use their platform (and, by extension, the people who visit this site) more than Stripe. Back in 2013, when my co-founder and I started a company and later got into YC, my co-founder went thru every circle of hell in order to fix all the mistakes we made when we incorporated. If Stripe Atlas had existed back then and we'd used it, this would just be a non-issue. Unless you're an expert in the technicalities of startup incorporation/bylaws/etc, the value Stripe Atlas provides is huge and it just doesn't make sense to me why someone would pass on it.
exhaze··on Curry Before Columbus
Can’t speak for the rest of the anglosphere, but in the US, when someone says “spicy”, they mean “this has too much capsaicin”. If someone were referring to the strength of the taste, they would probably just say “I don’t like this flavor”, or as a stretch, “the spices in this dish are too strong”. Not sure what point you’re making here. I assure you, even though there may not be dedicated words for them, English speakers are quite able to articulate the differences between the different categories of plants that are added to food to make it taste better.
exhaze··on Uber wants to cut costs by shifting its engineering to India
As someone who worked at Uber from 2014-2018, I'd like to weigh in with some observations based on my experience.

1). While Uber has been very Bay Area-heavy, it has had a distributed engineering team for many of its core operations for a very long time. For example, many of its core infrastructure was built in Europe. Cross-timezone collaboration hasn't been the smoothest, but of all the large "FANGish" tech companies, Uber actually has the most experience with non-HQ teams building business-critical systems. Even companies seen as very progressive in terms of eng culture, like Stripe, seem to keep the core business close to HQ (this is my subjective observation, and I'd love to proven wrong here, because I think Stripe, as a whole, is awesome).

2). India is a country with many people and many engineers. If there's one strong believe I can state in this post, it's that there are many incredibly talented engineers who are living in India and are choosing to stay there. Uber has experience in building engineering teams outside of HQ. It's not a sure thing, but I think they can do it.

Happy to answer any other questions or comments.

(I guess as a disclaimer, I have zero financial stake in Uber, but I have some friends who still work at Uber, so that may or may not influence my opinion)

exhaze··on Basecamp’s founders are trying to start an email rebellion
So you mean to say "email done your own uncompromising way"?
exhaze··on AWS services explained in one line each
> If you’re trying to understand how much a new deployment on AWS is costing you, and find ways to optimize that, you don’t care about the total budget of the account, or having some auto shutoff. You need detailed, real-time information from Amazon, which I’ve never seen in the console.

No one who is working on this cares about real-time by the second data - the daily cost is enough.

> Again, this is a strawman. This isn’t a response to anything I said.

OK, what are you trying to say? If my response above did not answer the question, can you give me a one sentence summary of the point?

exhaze··on AWS services explained in one line each
You bring up a good point - it would be a good idea for AWS to set some sensible max budget defaults for new accounts to prevent surprises.

Since they don't, if you are literally so concerned with your current costs for this month, you can set a budget and alerts for whatever you want, so that you don't exceed some cost. Also, they show you your current cost for this month, up until the moment, as well as a daily breakdown of your costs.

exhaze··on AWS services explained in one line each
You're right, it's shitty of them to not provide that out of the box. However, if it's such a big problem for you, as others have pointed out, it's easy to solve. If you are paying $500/month for S3, you must be processing quite a large amount of data - as another poster pointed out, there's an easy to fix it. If you weren't going to use S3 for this, what would you use instead for this use-case?
exhaze··on AWS services explained in one line each
I think we are probably 90% in agreement on things, just talking about it in different terms. I think AWS/GCP have both gotten overwhelming in terms of how many different services they provide. Many people fall for it and end up playing AWS service golf (https://news.ycombinator.com/item?id=23274668).

Maybe a good analogy is to think of AWS as C. It's flexible and powerful, but it's easy to shoot yourself in the foot. That would explain why a lot of these "> magical-tool deploy" services have emerged, promising to abstract away AWS.

exhaze··on AWS services explained in one line each
> Heck, at any given moment it's unexplainably hard to tell exactly which AWS services are you actually using, and being billed for.

Did you actually look at the billing page? Here's a screenshot of my billing page:

https://imgur.com/a/DQAxgRY

It meticulously breaks out per-service costs across whatever dimension you want. "EC2-Other" is rolled up in the chart, but it's broken out by each individual item further down in the list.

exhaze··on AWS services explained in one line each
It's literally called "Billing" and the "Cost Explorer" is the first item in the navigation when you go to the page. I've attached a screenshot and highlighted it for you. FYI, this month is the first time I've opened the AWS GUI in 4-5 months, and it took me about a minute to find the billing page and drill into our AWS costs. I've provided an image that shows how to get to the cost explorer from "Billing" (you can use the search box available on the AWS account landing page to type in "Billing" in order to access the billing page of AWS).

EDIT: sorry, I forgot to include the screenshot link - https://imgur.com/a/tVFoocr

exhaze··on Software will eat software in a remote-first world
> Maybe you consider Kubernetes an old technology by now? Maybe you consider React.js an old technology by now? What about docker? How about ES6?

My father (and many others like him) has been programming in C at a prominent SV company for the past 15 years (OK, it's based in the South Bay). I know many people in SF doing similar jobs, just coding away in Java or C++. Those people come to work, do their work, then go home. They don't tweet, or write Medium posts, or have dark green GitHub activity profiles. They don't work with you, so they don't talk to you. You aren't aware they exist. However, these people build many of the systems that make our day-to-day lives possible.

> I'm not denying either of these facts but it doesn't stop the small town engineers from existing.

I'm not saying they don't exist, I'm just saying that there just aren't that many of them.

exhaze··on AWS services explained in one line each
Have you ever used AWS? There's a whole suite of tools they provide around pricing and budgeting.

> It's quite a tour de force how Amazon have taken "separation of concerns", applied it to web services and used it to create complex and difficult to understand or predict pricing to print money.

Is applying separation of concerns to web services really that bad? Look, if you're a small company with a simple product, you can just put your stuff on a few EC2 boxes and pay the monthly bill for that. At that size, your infra costs are going to be dwarfed by your other costs of doing business anyway. If you're a big business, you can literally pay people to keep track of this stuff. You've got the extra money, because now you don't employ data center architects, server engineers, etc. AWS is able to "print money" because it brings a lot of value to many businesses.

exhaze··on Software will eat software in a remote-first world
> Being a software engineer in SF means constantly learning new tech and 'keeping up'

No, it does not.

> You would be surprised at how many people value their hometown or where they have settled.

I would love to see actual data about this rather than articles from hometown newspapers and posts by hometown residents, enthusiastically praising their way of life. It's easy to argue the counterpoint as well, right?

1). There are many jobs that have to be done in person 2). Many people prefer to live in large cities and accept the downsides in order to get the benefits

So, next time you want to make a claim like this, can you share anything objective about this? Thanks.

exhaze··on She Gets Calls and Texts Meant for Elon Musk. Some Are Pretty Weird
U R NOT COMPLIANT ON UR TAXES. REPLY 1 TO PAY, REPLY 2 TO GO TO JAIL
exhaze··on Show HN: Errorship, use datadog as an error tracker
> The main benefit is that you do not have to context switch from datadog metrics/logs to go look at your exceptions in sentry.

Sentry lets you send exceptions to Datadog though?

← PreviousPage 5 of 7Next →