HNHacker News
TopNewBestAskShowJobs

oggy

275 karma · joined May 8, 2012

To contact me, substitute g for b in obi@mynosefroze.com
submissionscomments
oggy··on Show HN: A Covid-19 testing location site that a group of us are building
Feedback on the website: it's running quite slow for me on Chromium under Linux, especially if there are a lot of locations (for example, unchecking "exclude public health agencies" makes the site very unresponsive). Also, "exclude local public health agencies" is confusing; I'd expect selecting it to show only those that aren't local public health agencies, but it seems to have the opposite effect. Finally, if I click on one of the locations, what I assume to be X-marks are displayed as just rectangles (I guess a missing Unicode symbol in the font on my machine).

Thanks again for making this!

oggy··on Show HN: A Covid-19 testing location site that a group of us are building
Thank you for the work on this.

I have a tangentially related question, hoping that someone knowledgeable can answer. What are the main bottlenecks to scaling testing, in particular in the following stages:

- the supply of virus-specific reagents (primers, perhaps virus-specific reporting probes - are these necessary, or can just generic reporters be used?)

- the supply of other reagents (in case of PCR, polymerase, nucleotide material, buffer)

- the supply of disposable testing equipment. I know that swabs are in short supply for some reason, anything else?

- safety in handling both the samples and the amplified product (can you basically flush the processed sample down the toilet, or do you need to handle it with extreme precautions)

oggy··on Testing the Efficacy of Homemade Masks: Protection in Influenza Pandemic? (2013) [pdf]
Interesting, this is the first time I hear that touching fomites is the primary vector of spreading. The CDC page says the opposite: https://www.cdc.gov/coronavirus/2019-ncov/prepare/transmissi... But I do appreciate that we still have a lot to learn about the virus, so disinfecting your hands frequently and being careful about what you touch is sound advice.

The other benefit of masks (and probably the main one of DIY masks) would be that it decreases the chance of the wearer infecting others.

oggy··on Effect of economic crisis on America’s small businesses [slides]
I agree that we shouldn't be taking the supply away from the professionals while there's a shortage, but your statement was that they were ineffective in the hands of laymen, and I don't think that's true.

I'm not assuming that they are 50% effective either, I pulled the 50% number out of my ass, but so is your 0%, and I find it hard to imagine a physical reality where me keeping a 6 feet distance to an infected person decreases my infection probability significantly more than that person wearing a mask. Anecdotally, South Korea, Japan, Hong Kong, and Taiwan, where wearing masks is quite commonplace all seem to be doing better in transmission rate than the Western world, and all that without killing their economies. And considering that we're producing around 2 billion disposable plastic bottles a day, I'd currently bet money that we should be able to ramp up the supply of cheap masks for a sum that's a lot less than that of halting 50% of the Western economy for several months. Obviously, it can't happen in a day, but I'm not really seeing anyone try, except for perhaps Trump after his recent epiphany that Corona is not a Democrats' hoax. I'm willing to be dissuaded by someone who's actually thought it through, but sadly I haven't seen any such analyses.

oggy··on Effect of economic crisis on America’s small businesses [slides]
The effectiveness doesn't need to be perfect. If I'm now only 50% less contagious to others with my no-longer-sterile mask, that's a huge win.
oggy··on Effect of economic crisis on America’s small businesses [slides]
If there are 100 or more asymptomatic and untested cases per tested case, then the disease is very highly contagious, given the timeframe we're looking at.
oggy··on Effect of economic crisis on America’s small businesses [slides]
What do you base the months and months estimate on?
oggy··on Effect of economic crisis on America’s small businesses [slides]
I'm trying to learn a bit more about how testing works. Aside from the logistics (getting the samples to the lab, etc), what are the necessary steps for sample prep? Heating to inactivate the virus? Splitting the sample into RNA/DNA/proteins?

Also, where do you draw the numbers of primer production capacity from? IIUC, the only other things that an amplification needs are enzymes (just DNA polymerase for PCR) and "food" (nucleotides), but that I assume is not a bottleneck?

How difficult is it to safely dispose of amplified samples? Can you basically just dump them in the toilet?

oggy··on The hard part of the economics of Covid-19
I'm pretty confused by the European government's responses. While the UK is the most brazen, all others are essentially also saying that there's no other way other than letting a non-negligible percentage of the population die, and that the best they can do is try to ensure that everyone who needs an ICU gets one. And all the while incurring a massive economic cost. Italy, France, Switzerland and Austria have effectively halted most of the economic activity, initially for 2 weeks to a month, but it's likely that it's either going to be longer, or that they'll have to repeat the process. That's 100s of billions of dollars gone just there, not counting for the long-term impact and all the social problems that'll follow. I'm puzzled that the idle workforce and the lost money isn't diverted to urgent and massive scaling of testing and protection equipment.

Of course, all it takes is a UK to screw everyone over by not playing along and providing a population pool for the virus to mutate. And then a ton of poor countries who probably can't do anything even if they wanted, where it's just starting.

oggy··on The difference between isolation levels and consistency levels
The Herlihy-Wing paper defining linearizability is a good read https://cs.brown.edu/~mph/HerlihyW90/p463-herlihy.pdf and explains the difference with good examples, although it might be too mathy/formal for most people's taste. An interesting result in that paper is that the implementations of what Abadi calls isolation notions (which Herlihy and Wing call multi-object correctness criteria) are not modular - at least for (strict) serializability. For example, if two systems implement serializability using two-phase locking and multi-version concurrency control respectively, then they can't be modularly composed to get a serializable global system for transactions that span objects from both systems.
oggy··on Digital Asset Open Sources Its Smart Contract Language, DAML [pdf]
The DAML landing page gives a nice overview of the unique language features:

https://daml.com/

Disclaimer: I work there. Very exciting to see it open-sourced!

oggy··on Keeping CALM: when distributed consistency is easy
No, you don't get linearizability of all operations, you might not even read your earlier writes - but the whole point is that you sometimes don't need these guarantees for reads. You get a consistent snapshot read, and that's often good enough. You can get an idea of how recent the snapshot is based on timestamps, but "recent" is hard to define in a distributed system.
oggy··on Keeping CALM: when distributed consistency is easy
You're comparing apples to oranges. If read coordination can be avoided (and it often can, even in systems with consensus), whether you stick a cache on the client or not is completely orthogonal to whether the system uses consensus for write operations.
oggy··on Keeping CALM: when distributed consistency is easy
That's not really true. With a single, non-replicated server, you're also very much exposed to network failures. If the server's connection goes down, you're screwed. Compare this to a Google replication setup of 2 East Cost, 2 West Coast, and 1 central USA server. The client must only be able to reach two out of three data centers (and they have to be able to communicate with each other). That sounds much more resilient to me - and I guess Google agrees, since they deploy the setup.
oggy··on Keeping CALM: when distributed consistency is easy
That's an excellent explanation, except for couple of points which I think can be misinterpreted. A distributed system with consensus will in practice provide higher availability than a single-node system, because it provides fault-tolerance. In fact, fault-tolerance is the primary point of using (non-Byzantine) consensus. But you are absolutely right that a distributed system using consensus has worse availability than a distributed system with no coordination.

Also, when using a system "with consensus" there is often no need to actually invoke consensus on the read side of the system, in which case you don't have to pay the throughput and latency penalties. I know you've sort of said this already, but it might be helpful to mention explicitly.

oggy··on New flaws in 4G, 5G allow attackers to intercept calls and track phone locations
Based on the paper, the title is clickbait; it does not talk about intercepting calls at all. It does mention that one of the attacks in the paper can enable "further attacks", but if call interception was one of them, I'd imagine that they'd say so explicitly.
oggy··on It’s Time to Move on from Two Phase Commit
What is your definition of a nondeterministic system then? Typically it's a system with a non-deterministic transition relation. E.g., assuming for simplicity a system state sharded into two shards with numerical states, and the initial system state (0, 0), a non-deterministic operation can take (0, 0) to either (1, 1) or (2, 2). Then if you let each shard's replicas run independently, you could end up in an inconsistent state (either (1, 2) or (2, 1)).

So I suppose that your definition of nondeterministic must differ, but I can't figure out how.

oggy··on It’s Time to Move on from Two Phase Commit
I don't understand how this can be generalized to non-deterministic systems. First off, the definition of non-deterministic is unclear to me. His definition of deterministic seems wrong, as he's using a set of requests. Sets are unordered, so this would imply that the order in which requests execute is irrelevant - which is true for commutative operations, but Calvin doesn't seem to be limited to those.

Assuming that "deterministic" should be defined on lists of inputs, then I don't understand how the approach can be applied to nondeterministic databases. The crux seems of the approach seems to be in consistent distributed reads (which you can get by globally ordering transactions and MVCC). But for fault-tolerance, these must also be repeatable, and I don't see how to make them repeatable if the state of replicas in a shard is allowed to diverge.

oggy··on It’s Time to Move on from Two Phase Commit
I don't understand your point about only a subset of shards running code that may abort. Since we are talking about transactions, if there is even a single shard S that may abort (based on its state), then all other shards must also abort when S aborts. Which would imply that all other shards must also read the state of S before they commit. Am I missing something?
oggy··on Why Don't People Use Formal Methods?
Last week I took part in a formal methods workshop where one of the topics discussed was "why we don't have formal specs for most things" (which is a more modest ask than verification). Many things we came up with were what you'd expect: additional cost (which has to be taken into account when changing programs), missing incentives, lack of awareness of FM existence, lack of training, unpolished tooling.

Other, less obvious ones included the inherent difficulty in writing the specs. Namely, FM is about verifying that a system model conforms to a specification. For this to bring value, the specification has to be significantly simpler than the model that we can deem it "obviously correct". But such specifications can be extremely difficult to find. On one hand, they are abstractions of the model, and finding good abstractions is one of the hardest parts of software engineering. Another way to think about it is Kolmogorov complexity; at some point you cannot "compress" the description of a problem any further, i.e., some problems are just difficult by nature.

On the incentives front, one of the interesting viewpoints brought up was that having formal specs for your product can make you more liable for defects, and that some (in particular, hardware vendors) might prefer to have wiggle room there. E.g., consider the Spectre/Meltdown fiasco and Intel's response. Another thing brought up there was that software vendors often don't directly feel the cost of the bugs in their software, at least not short-term. This is different in hardware; e.g. ARM uses FM extensively, though I don't know if they commit to specs publicly. The RISC-V architecture comes with a formal spec, though.

On the other hand, I think that many of the current trends in the computing world are making FM more aligned with the incentives of a core part of the industry. The cloud brings centralization, with few large companies (Amazon, Google, etc) providing a lot of complicated software infrastructure that's critical to their success. An outage of an AWS service directly costs them significant money, and can easily completely halt the customers' operations. Moreover, they operate in an open and potentially hostile environment; a corner case software bug in MS Office wasn't a big deal, and maybe could be "fixed" by providing the customer a workaround. But such a bug in a cloud service can become an exploitable security vulnerability. And in fact you do see AWS having a dedicated formal methods team. Also, the TLS 1.3 development included formal verification. On the other hand, AFAIK Google doesn't employ FMs that much, even though they are in the same game as Amazon with GCP; so there's definitely a cultural component to it as well. But I still believe that it's likely that we end up with a small core of companies that provides a lot of critical infrastructure that heavily uses FM, and that we see little adoption of FM outside of this circle.

As for the article, I agree with most points made, though it unsurprisingly has a bias for using TLA with TLC. I agree that TLA/TLC can often be the best solution, but there are caveats. For example, models can be awkward (e.g., recursive data structures), the specification language is limited, and "just throwing more hardware at it" doesn't really work that great for exponential-time problems.

oggy··on Theorem of the Day
For more random interesting theorems with outrageously clever and beautiful proofs, the "Proofs from THE BOOK" [1] book is a fantastic collection. As a curiosity, "THE BOOK" in the title comes from Erdos, who often referred to the book in which God keeps nice proofs of math theorems :)

[1]: https://www.amazon.com/Proofs-BOOK-Martin-Aigner/dp/36420085...

oggy··on A More Flexible Paxos
Consensus is not about transactions, it's about agreeing on a value (a single value, strictly speaking, unlike atomic broadcast, which is about agreeing on a sequence of values, although people often identify the two). But anyway, your argument is not in any way concrete - try to come up with a counterexample. Having thought about it more, I am confident that the author's system is correct (in the sense that it always preserves agreement).
oggy··on A More Flexible Paxos
The split-brain scenarios you mention cannot occur, since all the proposals have to go through the leader before they are agreed to by any processes.

Moreover, the leaders are lease-based in the author's proposal, so I believe that what he describes correctly solves consensus. However, his proposal doesn't really give much of a resilience improvement over the original Paxos, since the system, in the worst case, tolerates only 2 failures (leader + one more process), same as a 5-process Paxos. Nevertheless, an interesting idea, one that I don't think I've seen elsewhere.

oggy··on Intero for Emacs: complete interactive development program for Haskell
It didn't "just work (TM)" for me, I had to customize the intero-package-version in my .emacs when using it with a project with the latest stack-nightly, to bump it up to "0.1.16".

But other than that, wow! I was already very happy whenever I could get ghc-mod and haskell-mode to work, but this takes the responsiveness to a whole different level.

oggy··on Test flight held for small jet modeled after Miyazaki anime
And the 3rd person version:

https://www.youtube.com/watch?v=17elclJuXxQ

oggy··on One-sentence proof of Fermat's theorem on sums of two squares
Thanks for that post, that's interesting. Do you by chance have any pointers to a good textbook that covers these things?
oggy··on The Story of Haskell at IMVU
> Haskell -- like other pure FP languages -- is built around > the approximation of denotational semantics,

Interesting, do you have any references for this? I thought that the primary reason for purity was to enable equational reasoning, but I have no sources for this. Also, AFAIK, there are no formal semantics for Haskell?

oggy··on Top Books on Amazon Based on Links in Hacker News Comments
Yes, I also use CLR(S) as a reference, when I need to quickly look up an algorithm. But it doesn't really explain how to come up with algorithms - for that, my favorite is Udi Manber's "Introduction to Algorithms: A Creative Approach". It's ridiculously pricey though.
oggy··on FSCQ: A formally verified crash-proof filesystem [pdf]
That's pretty awesome that you could get this verified down to the implementation. We had a related project [1], where we verified a persistent storage system under restarts. Our case study was much simpler than a full fledged file system, and we didn't verify an implementation, but we did also consider hardware failures (partial writes, bitrot, etc). Our proof rules are different though, and I think pretty interesting. But some other choices that we made were in hindsight suboptimal, and some points in your paper resonated with me in a "yup, would do it this way now" way. Really nice work!

[1]: http://mynosefroze.com/pubs/fm2014.pdf

oggy··on Signal for Android: RedPhone and TextSecure in one app
This is great news, and thanks to everyone involved. I've been using TextSecure for a while, and it's really "pretty good security made easy". Yes it is not perfect for the super privacy-conscious (depends on Google Play services and all that) and a fork with these features might be useful, but if I understand the motivation correctly, the main goal is to make good crypto accessible to the masses.

I do have a personal gripe with that, though. I'm hoping a "high up" might read it so I am posting it here. The only people in my contact list who use the app are crypto nerds. It's really hard to get traction. I thought that the TextSecure people had a great idea to solve this chicken and egg problem; a unified messaging app that would handle your sms, and send secure messages wherever possible. One feature that I find is missing though, is the ability to semd broadcast (unencrypted) sms texts. In my experience (Europe, people around 30) this is used a lot, and a drop-in replacement for the built-in messenger would need to have this.

Actually, I would like to see this happen so much that I would be willing to do the work, if someone is willing to provide the handholding...

← PreviousPage 2 of 4Next →