Came up with something similar a for myself: https://mprimi.github.io/portable-secret/ it was well liked by HN: https://news.ycombinator.com/item?id=34083366
1,164 karma · joined October 16, 2020
Here’s something similar-ish but using symmetric encryption (i.e. password):
I had the foolish idea of installing a Tesla charger at home to charge my Bolt. I’ve been unable to ever use it.
The wall charger works fine with Teslas. My car and adapter charge fine at Tesla superchargers.
But the home Tesla charger refuses to charge my Bolt. (Yes I disabled vehicle restrictions and tried all sorts of combinations of settings for weeks before giving up. Tesla support was useless of course)
Restriction or bug, same difference.
That's the NATS Go _client_.
The server project is https://github.com/nats-io/nats-server 17k stars, 1.5k forks, 160 contributors
IANAP but here’s my understanding.
At the end of the month you spent $2000, you’re not sure how so you track down your expenses:
- rent $500
- groceries $120
- gas $80
- …
- unknown: $123
(Russia is really good at weaponizing memes but I don’t meant to single it out, the US has also been very successfully influencing the same country for decades via Hollywood movies for example)
- There is someone else that is better at X than you are
- The person not so good at X is probably better than you at YParent was asking about deduping encrypted data.
Someone said (wrongly) it’s impossible and I shared a popular project that does exactly that.
My bookmark archive is 10TB but deduped on-disk size is 100GB because most files are the same across backups!
Water treatment is powered by the geyser and in turn the leftover brown water feeds the geyser.
Pretty neat (for sewage)!
Process 1 receives: 3:00 [1] "P1 is leader" 3:01 [2] "P2 is leader"
Process 2 receives: 3:00 [1] "P1 is leader" 4:00 [2] "P2 is leader"
This is perfectly valid Atomic Broadcast. Order is maintained.
However from 3:01 to 4:00PM you have 2 leaders (or 2 processes holding the lock).
Don't use ABCast to do locking / leader election for your "user-space" application!
Rounding down 'usually works' to 'it's not perfect and we need to handle edge cases' is how you build dependable systems.
Your first comment seemed very much in the first camp to me.
When programmers think of locks, they think of something that can be used to guarantee mutual exclusion.
Distributed locks have edge cases where mutual exclusion is violated.
Implementation does not matter.
e.g. imagine someone shows you a design for a perpetual motion machine. You don't need to know the details to know it doesn't work! It would violate the laws of physics!
Similarly, anyone telling you they created an implementation of a distributed lock that is safe, is claiming their system breaks the laws of information theory.
"Distributed locks" are at best contention-reduction mechanisms. i.e. they can keep multiple processes from piling up and slowing each other down.
[Some] Paxos for example use leader election to streamline the protocol and achieve high throughput. But Paxos safety does NOT depend on it. If there are multiple leaders active (which will inevitably happen), the protocol still guarantees its safety properties.
Atomic Broadcast guarantees order of delivery. It does not (cannot) guarantee timing of delivery. Which is what people want and expect when using distributed lock / leader election.
TCP guarantees order [as long as the connection is active] but it is far from being 'perfectly reliable'.
Example: sender sends, connection drops, sender has no idea whether the receiver received.
In other words, it works until it doesn't. The fact that sometimes it doesn't means it's not perfect.
TCP is a great tool but it doesn't violate the laws of physics. The 2 generals problems is and will always be impossible.
I could not get past the point where you promulgate the idea that ZK can be used to implement locks.
Traditionally a 'lock' guarantees mutual exclusion between threads or processes.
"Distributed locks" are not locks at all. They look the same from API perspective, but they have much weaker properties. They cannot be used to guarantee mutual exclusion.
I think any mention of distributed locks / leader election should come with a giant warning: THESE LOCKS ARE NOT AS STRONG AS THE ONES YOU ARE USED TO. Skipping this warning is doing a disservice to your readers.
Atomic Broadcast (via Paxos or RAFT) does not depend on partial synchrony assumptions to maintain its safety properties.
Your internet or intranet networks are definitely asynchronous and assuming delays are bound is a recipe for building crappy systems that will inevitably fail on you in hard to debug ways.
I've seen way too many systems where people assume TCP == perfectly reliable and distributed locks == mutual exclusion. Which of course it's not the case.
I’m the ‘maintainer’ but I’m hands off and not planning on significant improvements.
Discussion on HN was also quite interesting and you may find some ideas: https://news.ycombinator.com/item?id=34083366
I also recently presented this at HOPE(.net) and was very well received by a technical crowd so congrats on independently inventing the same thing ;-)
I didn’t read past this:
> Systems like Apache ZooKeeper or Postgres (via Advisory Locks) provide the required building blocks for this
Zookeeper is the original sin. Convincing a whole generation of programmers that distributed lock are a feasible solution.
This is my biggest pet peeve in distributed systems.
——
And if you don’t believe me, maybe you’ll trust Kyle K. of Jepsen fame:
> However, perfect failure detectors are impossible in asynchronous networks.
Links to: https://www.cs.utexas.edu/~lorenzo/corsi/cs380d/papers/p225-...
1. Many companies are hiring "AI" engineers. My guess is 90% of these jobs are virtue signaling to investors and those positions will go to folks that are good at appearing competent in interviews. Yay! More overpaid incompetent colleagues, just what we need.
2. My editor saves me about 2 minutes a day with smart printf/loop/variable completions (JetBrains editors -- no sarcasm, i like this!)
3. I am wasting time responding to email from PMs suggesting that "we don't have engineering capacity to do XYZ, but maybe we can use an AI to do it???"
(I am not anti-GenAI -- I've used it to create flyers and do pretty cool stuff!)
Among the many uses, they have been applied to ‘evolving’ neural networks.
Famously a guy whose name I can’t remember used to generate programs and mutations of programs.
My recommendation if you want to get into AI: avoid anything written in the last 10 years and explore some classics from the 70s
(I’m being a bit provocative and assume today it stores locally only but a future TOS change will secretly and “anonymously” upload your data ‘for training purposes’ —- that’s what everyone else is doing these days)
The upsides are: - it’s git! Everything is versioned and easy to sync to one more place - it uses disk more efficiently than git (no double disk usage for objects and checkout)
The downside: - it’s a pain to get it building and working on a new system (Haskell)
-—graph -—oneline -—colorThis thing is magic (or rather, it's indistinguishable from magic ;-)).
If they told me I could test any distributed system without a single line of code change, do things like step-by-step debugging, even rollback time at will, I would not believe it. But Antithesis works as advertised.
It's a game-changer for distributed systems that truly care about dependability.