HNHacker News
TopNewBestAskShowJobs

WestCoastJustin

12,964 karma · joined May 12, 2010

Opinions expressed here are solely my own.
submissionscomments
WestCoastJustin··on A Linux sysadmin's introduction to cgroups
Yeah, I think you're right about the BSD jails point. This totally pre-dates the Linux piece. I was only chatting about the Linux piece.
WestCoastJustin··on A Linux sysadmin's introduction to cgroups
I don't believe so. "Engineers at Google (primarily Paul Menage and Rohit Seth) started the work on this feature in 2006 under the name "process containers"." [1] Here's the kernel patch from Google that was merged into the Linux Kernel from 2006 [2]. Google used this tech in their Borg cluster manager that way pre-dates Docker/Kubernetes/etc. I'm sure other folks jumped in an helped out after the fact but this was created at Google.

[1] https://en.wikipedia.org/wiki/Cgroups

[2] https://lwn.net/Articles/199643/

WestCoastJustin··on A Linux sysadmin's introduction to cgroups
Yeah, funny how it all worked out. cgroups/namespaces powered simple LXC containers. Docker comes along and makes a nice workflow and package management system (wrapping cgroups/namespaces). Kubernetes comes along and makes a nice workflow/cluster management layer (wrapping Docker). Cloud providers come along and make a nice Kubernetes management layer (wrapping Kubernetes). Pretty crazy to see the evolution over the past few years.

This tech has completely changed the sysadmin landscape/job descriptions and sort of threw tons of gas the whole devops movement.

Disclaimer: I worked at both Docker & Google. Although not on this tech specifically. Opinions are my own here.

WestCoastJustin··on A Linux sysadmin's introduction to cgroups
This is getting a little long in the tooth but I created a few videos and did some tests around cgroups back in 2013-2014. Both these help explain the underpinnings of Docker and I guess Kubernetes now too. Turtles all the way up. I'm just mentioning this since these are still some of my most popular videos and still the core tech under the hood.

A personal note here too. cgroups were invented at Google in the early 2000's. If you're using search today, gmail, docs, maps, etc. You're using cgroups. It sounds simple but this tech really powered a whole wave of innovation/startups/projects that almost everyone interacts with on a daily basis. Either through touching a Google service or interacting with anyone using Docker or Kubernetes (running on cgroups/namespaces). Pretty impressive.

#14 - Introduction to Linux Control Groups (Cgroups)

https://sysadmincasts.com/episodes/14-introduction-to-linux-...

#24 - Introduction to Containers on Linux using LXC

https://sysadmincasts.com/episodes/24-introduction-to-contai...

WestCoastJustin··on Ask HN: Coping when your client is an asshole?
Maybe exercise the company expense card and start having dinners / drinks with these folks. They might be less assholish if you wine and dine them a little. Normally, I would say fire them but from the sounds of it you are too far gone. Drinks, breaking bread, and having a few laughs might smooth things over. At the very lease you can eat out at some fancy places and tell the folks at work you are smoothing things over. This could be tough if you hate them though.
WestCoastJustin··on Huawei reviewing FedEx relationship, says packages 'diverted'
Routing mistake?
WestCoastJustin··on Ask HN: How can I work towards building a company while employed?
Do not do anything non-work related on company equipment! Ever, for any reason, seriously don't do it! Do not even research the idea! Assume the company is logging everything. They likely are. Honestly, I'd just focus on work and learn if you are just starting out. Learn as much as you can while employed by other folks (they are basically paying you to learn). Learn as much about the business your company is in too. For example, say you are a software dev at a VFX company. You might only care about your specific dev project in a tiny silo. But, learn the larger context of where your piece fits into the bigger company picture or industry. Learn about your company, where it fits into the bigger picture, where are things headed in your industry. This will open all types of jobs opportunities as you can pivot around in your industry. Why are you doing what you are doing? This will really help you down the road when you start your company as you want to think of the larger workflows and where you fit in. Focus on workflows as the underlining tech constantly changes (but workflows rarely do)! Running a company is a 24/7 thing, you will not get weekend or nights off, so don't burn yourself out working for someone else and doing your own thing useless you really think it will work. I have tons of 10% complete projects that I thought where good ideas but never panned out. So, just play around and see what might work. Don't take it all the way unless you are really sure.

If you want a job at something like gitlab. Hangout on their open-source project, learn their codebase, and send in patches. Even if they are simple docs patches. Send in 50 of those and you will start to learn the devs. Ask one of them what it is like to work there, ask them to refer you, etc. The CEO of gitlab is constantly on HN (I swear he has an alert for mention of gitlab). So, he will likely see this post. My point, take some initiative and try not to go through the conventional recruiter pipe (apply on website and no one ever gets back to you cycle). Doing this, has worked out really well for me in the past, and it will work for you too. Sure, it is more work but gets you ahead of everyone else as you are making an effort. Be strategic about this and really choose who you want to work for and go after them. Having something like, hey, I patched 50 minor typos in your code/docs goes a long way, between you and some nobody!

WestCoastJustin··on Containers, microservices, and service meshes
+1 for Jerome. Love reading these.

Nick, long time no see. Hope thing are well. Amazing who you find browsing these threads :)

WestCoastJustin··on Faux Rogan
How can I do this with my voice? Any suggestions? I run a site called https://sysadmincasts.com/ with tons of voiceovers and would love to automate this (without it sounding like crap). There are always places where I need to update the audio with small tweaks. I imagine it is still pretty computerized today but I think we'll eventually get there. The google WaveNet stuff is pretty good but still not there yet [1].

I imagine eventually, you could have some type of transcript that's annotated with speech synthesis markup language (SSML). Then, you have a CI/CD pipeline that would run this text-to-speech engine and regenerate the audio. I could then pair this up with the video. I honestly wonder if we are a year or two away from this being possible.

[1] https://cloud.google.com/text-to-speech/

WestCoastJustin··on GKE Sandbox: Independent operating system kernel to each container
Well, it happened and on a pretty popular site too. So if they got it wrong how many other people do. This is a core reason folk should check out gVisor. Not sure why the downvotes as this is a pretty good example use-case?
WestCoastJustin··on GKE Sandbox: Independent operating system kernel to each container
Awesome, thanks. I need to dig into this a little and just run a few demos / labs. This makes sense though. I really like your comments on this thread too (https://news.ycombinator.com/item?id=16976392).
WestCoastJustin··on GKE Sandbox: Independent operating system kernel to each container
> re: seccomp

This thread has a good answer: https://news.ycombinator.com/item?id=16976392

> "containers do not contain"

Is sort of troll bait. They do contain. That is why everyone is using them. Sure, there will be exploits to break out of them, just like with VMs, and even CPU bugs now.

Here is a good example of someone who broke out of a container on the play-with-docker.com site using a custom kernel module [1]. This allowed a container escape but you could say this was a bug since that wasn't the intent. So, you'd patch it. So, I get the joke in that people are extremely creative and will find ways around everything.

[1] https://www.cyberark.com/threat-research-blog/how-i-hacked-p...

WestCoastJustin··on GKE Sandbox: Independent operating system kernel to each container
Ah, cool, thanks. I didn't know they were running that under the hood. Yeah, I've checked out Cloud Run via a screencast I did on it a few weeks back [1]. I really like the concept and am looking forward to seeing the evolution of it!

[1] https://sysadmincasts.com/episodes/69-cloud-run-with-knative

WestCoastJustin··on GKE Sandbox: Independent operating system kernel to each container
For anyone who hasn't seen this before. There is a pretty good gVisor Architecture Guide that explains how this works pretty well via a few diagrams [1]. Lots more info on these pages too [2, 3].

> gVisor intercepts application system calls and acts as the guest kernel, without the need for translation through virtualized hardware. gVisor may be thought of as either a merged guest kernel and VMM, or as seccomp on steroids. This architecture allows it to provide a flexible resource footprint (i.e. one based on threads and memory mappings, not fixed guest physical resources) while also lowering the fixed costs of virtualization. However, this comes at the price of reduced application compatibility and higher per-system call overhead.

From what I understand, basically a user-space program that wraps your container and intercepts all system calls. You can then allow/deny/re-wire them (based on a config). So, you have pretty much complete control over what your apps can do.

This for me, is sort of the key takeway from the blog post too: "because we use gVisor to increase the security of Google's own internal workloads, it continuously benefits from our expertise and experience running containers at scale in a security-first environment". So, Google's using something like this internally too for their own workloads, which should be a pretty good sign this works in real life.

[1] https://gvisor.dev/docs/architecture_guide/

[2] https://github.com/google/gvisor

[3] https://gvisor.dev/

WestCoastJustin··on CrowdStrike S-1
Thank you. Makes much more sense now.
WestCoastJustin··on CrowdStrike S-1
Anyone know why this is so popular and getting upvoted?
WestCoastJustin··on Hootsuite employees describe internal chaos following mass layoffs
> On April 29, Hootsuite CEO Ryan Holmes emailed staff saying layoffs were coming and would be completed by end-of-day on April 30. He said the firm would give a “full debrief” at a town hall meeting on May 2. “I appreciate these next few hours will be stressful,” he wrote.

> Some employees said they waited at their desks the rest of the day for news about who would be affected. The majority of the cuts were in North America and Asia, with the Singapore office being closed entirely, according to a post from one employee. The company’s European workforce also saw reductions."

> “The way this was handled…was insane,” wrote one employee. “You try sitting all day with that email hanging over your head and then being let go and bundled out the door as if you are a risk to company moral [sic] – as if anything could be more demoralizing than seeing valued colleagues get frog marched out of the office as they are crying. Absolute shit show.”

I wonder if there is a management chapter somewhere that walks you through how to do a mass layoff? Telling everyone to sit at their desks and wait to see what happens.. seems like a bad option. I guess there are no real good options here but this seems extremely stressful and rushed.

WestCoastJustin··on Improving Accuracy of Maps Using Anonymized GPS Traces
S2 Geometry [1] is a pretty cool library for anyone who hasn't need it before and it doing map stuff. They mention it in the article half way through. Allows you to programmatically bucket GPS data and quickly search adjoining cells, etc. I was using this for a wifi project a while back and was pretty awesome.

[1] http://s2geometry.io/

WestCoastJustin··on Slack S-1
Much of this goes into geo redundancy too. These 10M people are not in one place. So, you need redundant highly availably deployments in many regions. This does add lots of infrastructure duplication but is also super speedy for end users. This adds to the cost big time! For example, I was working with a gaming company and they had 10+ regions around the world, all using this type of setup, just to keep latency to an absolute minimum. I'm sure slack is doing the same.
WestCoastJustin··on Student used ‘USB Killer’ to destroy $58000 worth of computers
Reminds me of the Etherkiller and Friends at http://www.fiftythree.org/etherkiller/. I'm surprised this doesn't happen more often honestly.
WestCoastJustin··on Cloud Run – Newest member of our serverless compute stack
FYI - I just posted a review video where I walk through Cloud Run doing some demos. Check it out at: https://sysadmincasts.com/episodes/69-cloud-run-with-knative
WestCoastJustin··on Cloud Run beta pricing
FYI - I just posted a review video where I walk through Cloud Run doing some demos. Check it out at: https://sysadmincasts.com/episodes/69-cloud-run-with-knative
WestCoastJustin··on Is Google Stadia Doomed?
You still need an expensive GPU and constantly messing with drivers and upgrading your system. I guess we'll just have to see what happens but this seems like an inevitable evolution.
WestCoastJustin··on Is Google Stadia Doomed?
Yeah, I did read it. This line of thinking answers the question about ownership too. We already know the answer. People don't care.
WestCoastJustin··on Is Google Stadia Doomed?
Maybe think of it this way. How many people watch movies by going out and renting/purchasing a dvd. I'm willing to bet a lot less than 10 years ago. We're all doing it on-line. It sort of sounds like these cloud based gaming services want to mirror what netflix is doing. Sure, this is already happening to an extent.. but we still have to purchase the gaming console (dvd player vs just using your computer/smart tv). I guess that will have implications for the gaming blockbuster stores out there. If you look at it from that viewpoint it seems almost inevitable that it will happen eventually. Plus, from a consumer perspective you are isolated from having to cycle one less piece of hardware all the time. 10 years from now, how many people will have dedicated gaming consoles vs streaming online.. I'm willing to bet a lot more than today. I own maybe a handful of physical dvds and movies now.. its is all online. I'm totally happy about that too.

Same thing happened with cell phones. You used to have a walkman, dvd/cd player, a camera, a calculator, a pager, flashlight, notepad, etc. Now, you just have a phone.. add the gaming console to this list (and most other electronics too).

WestCoastJustin··on Integer overflow flaw discovered in libssh2 before 1.8.1
Nice catch. Didn't see that. Thanks for posting that. Yeah, pretty amazing these bugs are still kicking around even for something that has been looked at pretty critically. Makes this even more impressive.
WestCoastJustin··on Integer overflow flaw discovered in libssh2 before 1.8.1
TL/DR for anyone else looking for context.

> A malicious server could send a specially crafted packet which could result in an unchecked integer overflow. The value would then be used to allocate memory causing a possible memory write out of bounds error (CWE-130). [1]

Maybe now we can put a stop to all these ssh bots crawling the internet. Just setup a malicious ssh server ;). This CVE was part of a larger release of nine separate security advisories concerning libssh2 [2].

[1] https://www.libssh2.org/CVE-2019-3855.html

[2] https://www.openwall.com/lists/oss-security/2019/03/18/3

WestCoastJustin··on How can I become the best programmer in my field?
> attempt to be the best bilingual Japanese/English programmer working in fintech frontends

Except you'll be competing with patio11 so watch out.. haha. Nice seeing your comment here and want to echo about the writing what you learn part. This will help refine your ideas too. It also puts you on the map and you will start to build up a portfolio of sorts. This is great advice.

WestCoastJustin··on Xg2xg: Lookup table of similar tech and services for ex-Googlers
It is almost the other way around. Many of these open-source projects, have roots with engineers leaving these big companies and wanting to use the same tools, so they create them. Or, by these big companies releasing papers and then folks creating open-source versions. Here's some examples of the latter: Dapper (w/ OpenTracing) [1], Spanner (w/ CockroachDB) [2], Borg (w/ Mesos) [3], Dremel (w/ Drill) [4]. I'm sure there are tons more examples but these are just off the top of my head.

[1] https://ai.google/research/pubs/pub36356.pdf

[2] https://ai.google/research/pubs/pub39966.pdf

[3] https://ai.google/research/pubs/pub43438.pdf

[4] https://ai.google/research/pubs/pub36632.pdf

WestCoastJustin··on Cloud Run – Newest member of our serverless compute stack
FYI - thread from yesterday around the docs and concept: https://news.ycombinator.com/item?id=19610830

This appears to be the accompanying blog post. So, not a dupe and explains the higher level goal here. The post from yesterday, was before the product was actually publicly released, if that gives more context as to why this is new news.

← PreviousPage 4 of 34Next →