throwaway98121

You could write your own service... some thin agent that runs on your boxes and dumps the files every hour to some storage optimized boxes (your data lake)... where another process picks up those files periodically (or by getting a notification that something new is present) and loads them into a Postgres instance (you actually probably want column oriented).

Running every hour, you won’t get up to the second or minute data points. For more critical sections of code, maybe have your code directly log to an agent on the machine that periodically flushes those calls to some logging service.

I’m sure this is a great idea at some San Francisco start up full of unicorns who can do everything backed by endless venture capitalist cash.

I have spent a good chunk of my career at a Fortune 10 energy company.

We hired people who specialized in working with SAP, Oracle databases, MSSQL, messaging (think MSFT Lync), email infrastructure, physical servers for web apps, Cisco, desktop provisioning, application development, mobile device management, ticketing software, etc. etc.

It’s very hard and very expensive to acquire the right talent to manage a particular technology, administer it, support it, etc. Every vended software we work with has some company that looks at our name and comes up with some outrageous cost for a few licenses, dev seats, or whatever their business model is.

Acquiring the right quality talent is even harder. You bring them in. You try to teach them about your business so they feel valued and part of something big. They don’t stick around. They want to be at the Googles and Amazons of the world. They leave.

In this scenario, I’d rather use SQS than try to interview, hire, train, and make the hardware/software investment in running an SQS equivalent service in house. I don’t want to hire DBAs and build that profession in my org. It’s not our core business. My customers in the business don’t give a shit about it. They want something fast, reliable, and dependable.

Fundamentally, this argument of just do it yourself to save money is short sighted. There are a lot of factors. If you believe hiring Some internal teams is always cheaper than using managed services, you’re in for a world of hurt.

Any place with career opportunities means exorbitant housing costs and other taxes. Regardless of your politics, there’s a real wealth disparity, and increased demand is only driving up costs.

I don’t know what the solution is, but the first step is acknowledging the problem.

Marvelous Mrs. Maisal is on Amazon, not Netflix. Amazon also picked up season 4 of The Expanse after SciFi cancelled it. Good for them. Who needs cable???

Your views are entirely subjective.

To many, Trumps foreign policy seems to be centered on breaking down Western order in favor of despots and not from a strategic perspective in favor of American interests but entirely his own financial schemes.

Just about everyone from his administration has resigned, is in the midst of some investigation despite the Republican Party owning all branches of government, or both.

There have been over 30 indictments related to the various investigations the last time I checked.

The market has recently been wiped pretty hard. Issues are student loan debt are only getting worse, with the education secretary openly supporting predatory lending.

I haven’t even gotten to the environmental rollbacks.

I’m not saying the media is on Trump because they stand on some moral pedestal, but I do think something is seriously messed up, orthogonal to what any journalist or entertainer claims.

The thing Trump has succeeded at is propaganda. If only not for immigrants whether legal or illegal, it would be like the good old times when blacks were slaves or at least had to use separate water fountains. Hispanics and Muslims are supposedly parasites. I’m just repeating the things I hear my staunchly pro Trump colleagues say at work at a very Republican company (energy).

I have one coworker who literally said she’d support Trump even if he was found to be working with Russia the whole time. She believes he’s the only one who can protect us from Shariah law.

I think there are several real issues in this country. My personal politics are fiscal conservatism while being socially liberal. I’m now a democrat although I voted against Obama twice because the Republican Party has become the party of blind nationalism led by a conman with a deemphasis on critical thinking.

We recently binge watched both seasons of Stranger Things. Stranger Things and Altered Carbon on Netflix and The Marvelous Mrs Maisal and The Expanse on Amazon have been my most enjoyed shows this year.

Great summary with nice examples. Read through and bookmarked for when I will need this at work.

Clean code is an ambiguous and subjective concept.

Assuming you’re referring to the practices taught in the book, I disagree that it always delivers a higher value than messy code.

I worked with a code base recently that on the surface checks all the boxes, but honestly, the code was way over engineered for the problem it actually solves. The team itself was great at writing clean code, but they over indexed on it to the extent that they were paralyzed and couldn’t actually get anything out the door. Honestly, they don’t know how to deliver.

I would prefer a team or even one decent engineer who knows how to make trade offs. Instead of only optimizing your logic, also invest time to figure out how you’re rue going to deliver. Make sure there’s instrumentation and metrics. Load test your system and understand your dependencies and their limits. Do they need to scale too? What hardware do you need? If your traffic calculations are off and you have problems, how quickly will you be able to get back into your SLA... speaking of, what is the SLA? Have you built your run books? If dependency A fails or if this part of your architecture fails, what happens? Did we failure test? How many calls will this system get per second? Will it be sustained or bursts?

Thinking of software only as a code style optimization problem doesn’t work, unless you’re in an organization where developers are explicitly code monkeys.

IMO the thing this all highlights to me is that while many employees at large tech companies may believe they’re changing the world for the better or helping advance progressive ideas, their companies are just as two faced, greedy, and dishonest as any other industry.

I’m especially upset with the narcissism. I thought very highly of Sheryl Sandberg. I even thought Zuckerberg was an immature kid who is now trying to do the right thing, despite the mistakes. These people are just as selfish and self centered as the next person. I want Sheryl and Mark to take more responsibility but havent seen it.

Yeah, I think this is perfectly acceptable. If you don’t, don’t work for Amazon. Easy. I worked 12 hour days with a horrible boss as a fresh grad and only made $65k a year with a CS degree. This cat made $80k with a high school qualification, yet he still complains about a job he knowingly accepted.

I’m very interested to learn about Amazon tech, but instead I see an article just about everyday about how Amazon is some horrible sweatshop.

Ads on their website are annoying but this is a terrible article.

I absolutely despise Windows 10. I only deal with it for some gaming. What is your development workflow like? Any terminal? When I used the Ubuntu subsystem or whatever they call it, it was so slow pulling down some dependencies that it was unusable.

I grew up in poverty. As a kid, I had potato chips for breakfast if I ate at all and remember being hungry most mornings at school.

I just got my second promotion at a FAANG in three years. I have great work life balance. I can afford to buy food and more. I invest and max out my 401k and my older sibling is now in her final year of her residency and my younger sibling is almost done with bachelors. My spouse loves me. I was very sick this thanksgiving and it was nice to be taken care of. I still have anxiety and confidence issues, and I’m terribly afraid of risk... but it’s gotten substantially better than a few years ago.

Fair points, but these are all anecdotes. They don’t speak to macro trends. I certainly wouldn’t use these to state that FB is dying. The FB platforms demographics may be shifting, and the company itself has several offerings in its product line. The doom and gloom is purely speculative though. On paper, FB is a very solid company despite the recent stock sell offs.

IMO using the web console for your cloud development sounds like your a tiny shop. Your infrastructure and all that configuration should be in code and version control.

I think CloudFormation is difficult to use and could be much easier, but ops rant about the AWS UI being unfriendly makes it sound like he’s not really the kind of customer AWS is really after.

I would go on a limb and say that Amazon doesn’t invest in better UX because that’s not what most of their customers care about. Someone at that company has already done the math and decided investing in Amazon Go or 1 hour delivery or Whole Foods is a far better return than investing in UI improvement.

I do think people in this discussion are looking at this from a developer or designer point of view. I read some article a while ago about how Amazon saw a increase in sales from millisecond level improvement in page loads. I bet that’s what they optimize for, and less so on how pretty the UX is.

That all being said, I think Amazon is turning into EBay with all the garbage ads I see on the website, just trying to buy replacement toothbrush heads, but that’s an entirely different discussion.

The Expanse. Books and show are both great.

I’ve been reading these kinds of comments for several years now. Don’t get me wrong- I despise Facebook and these other exhibitionist platforms in general. I think there’s some truth and less teenagers using Facebook, but this notion that it’s a dying platform is wishful thinking at worst or speculation at best.

Btw, they’re not a trillion dollar company. Yes their stock value landed them there, but the market is overvalued. Last I checked, Amazons dropped 25% from all time highs, Netflix is in pain. Apple is in bear territory. Your running away with sensationalist news headlines. Even if Amazon hits $1 trillion, it’s numbers on paper. They’re a growth company facing economic headwinds with rising interest rates. If shareholders owning amazon cashed out, they would collapse.

How is Amazons deal in any way equal to your $1 an hour analogy? This is a serious question. Amazon will bring high paying jobs to the area. Those workers will pay taxes. They will also patronize local businesses. Yes, real estate will go nuts and infrastructure will have a tough time scaling, but your $1 an hour analogy is dishonest.

I grew up in Seattle. I know what Amazon will do, but again, your $1 analogy needs a citation. This is beyond hyperbole.