Something like linkerd on Kubernetes would be stronger, I suspect. But I don't know the exact nature of your problems.
955 karma · joined January 17, 2008
Something like linkerd on Kubernetes would be stronger, I suspect. But I don't know the exact nature of your problems.
I don’t have any daughters, but I’ve worked at some big social media companies, and this was required reading at one of them. The boss there did have daughters, but it wasn’t only so we would understand. It was so we wouldn’t build Trust and Safety headaches in the first place.
https://vietnamembassy-usa.org/news/2001/02/vietnam-puts-reg...
People just don't want to sit in traffic on the freeway for two hours a day for a serendipitous conversation that probably won't happen most of the time. If you think about it that way, it makes perfect sense.
"Our approach to blocking links" https://help.twitter.com/en/safety-and-security/phishing-spa...
"The Infrastructure Behind Twitter: Scale" https://blog.twitter.com/engineering/en_us/topics/infrastruc...
"Mux" https://twitter.github.io/finagle/guide/Protocols.html#mux
I do agree that some of this could be done better a decade later (like, using Rust for some things instead of Scala), but it was all considered. A single machine is a fun thing to think about, but not close to realistic. CPU time was not usually the concern in designing these systems.
Actually a good example of how difficult the problem is. A very common attack is to switch a bit.ly link or something like that to a malicious destination. You would also DoS the hosts... as the Mastodon folks are discovering (https://www.jwz.org/blog/2022/11/mastodon-stampede/)
For blocks/mutes, you have to account for retweets and quotes, it's just not a fun problem.
Shipping the product is much more difficult that what's in your post. It's not realistic at all, but it is fun to think about.
"Quant uses the warpcore zero-copy userspace UDP/IP stack, which in addition to running on on top of the standard Socket API has support for the netmap fast packet I/O framework, as well as the Particle and RIOT IoT stacks. Quant hence supports traditional POSIX platforms (Linux, MacOS, FreeBSD, etc.) as well as embedded systems."
I think every big internet service uses user-space networking where required, so that part isn't new.
In my experience, they mostly just catch bugs. Stuff like "hmm, our much better looking signup flow underperforms... oh, the form is broken on Safari." That kind of thing.
"Network Experimentation at Scale" from Facebook describes how difficult this problem is. Most A/B test frameworks don't reach this level of sophistication. It does make some sense to just ship things if you don't have time to build out something like that. (disclosure: I worked at Twitter long ago)
An interesting fact is that the big freeways and streets, like the periférico, usually follow the exact path of the causeways built for Tenochtitlan.
The former lakebed is also significantly more susceptible to earthquake damage than the land that formed the original banks or islands.
I think all of the various bad things people talk about here must happen sometimes, but it's mostly just retention I'd guess.
Once the migration is done, all you need is a few people that do some Bazel gardening every few weeks, and it's certainly not a full time job. This can be someone that does operations (CI, deployments, etc) or a product/infrastructure engineer, or one of each. Github / Gitlab scale to all but the largest projects, and even then, you can just split into two or three "monorepos" and kick the can down the road. With things like BuildBuddy, it's even easier.
As the article states, there are a lot of little of hidden costs and paper cuts when using a many-repo layout. The one that I've seen that's most prevalent is that it obscures copy/paste behavior, since it's much more difficult to detect in a many-repo setup.
Going to Bazel or equivalent is a bit of a mind adjustment, and some languages are better supported than others, but it really starts to pay off in larger projects. Especially if there's more than a few languages in use.
What usually happens these days is a redirect to the HTTPS site, but that first request can still be attacked.
For example, it's much easier to get a Chinese visa by paying this company across the street from the Chinese consulate in SF than it is to go there. I think everyone that speaks Chinese knows how to work the system, but I don't speak it at all.
They turned me down for having a bent corner on my passport, lol, after taking my money. I just gave up and used the company across the street for my second try.
I had to send my passport via Fedex to the Algerian consulate in NYC and cross my fingers. There are strange rules about whether you have to send it there or to Washington DC, based on which US state you live in (no one in the US cares about this).
Beyond that, it can be difficult for Americans to understand French with any unconventional accent, let alone understand Arabic at all. I know enough words to count and understand what the police say.
"For example, anyone who goes by a name that doesn’t match their government ID could be forced into an uncomfortable explanation"
I've seen this happen more than a few times, and the explanations are seldom anything you'd have sympathy for when discovered during a background check. People with good reasons will tell you up front.