HNHacker News
TopNewBestAskShowJobs

w1nk

181 karma · joined September 14, 2010

submissionscomments
w1nk··on Jump Trading sues 79-year-old Carl Sagan fan over wormhole.com domain
I have to imagine the existence of these guys in the space means whatever 'work on being immune' is probably not functioning very well :P.

These folks showing up in your trading arena means you've left money on the table and they're going to take that, and maybe some extra.

w1nk··on Jump Trading sues 79-year-old Carl Sagan fan over wormhole.com domain
These guys have specialized in building super low latency, line of sight microwave networks for trading, across multiple continents (chicago -> nyc, frankfurt -> london, etc):

https://sniperinmahwah.wordpress.com/2014/09/25/hft-in-my-ba...

https://www.bloomberg.com/news/features/2019-03-08/the-gazil...

http://www.amsterdamtrader.com/2014/09/hft-in-my-backyard.ht...

https://arstechnica.com/information-technology/2016/11/priva...

They employ skills such as kernel driver optimization specialists to squeeze every last ounce of performance out of network card drivers.

What the fuck are they doing messing with this? Yikes.

edit - I answered my own question. These dudes specialize in arbitrage and being faster than everyone else. The crypto markets are insane with this right now. The professional frontrunners have entered the game.

w1nk··on Show HN: Warp, a Rust-based terminal
As a user of sentry technically, you're also aware of how difficult it is to keep user information out of those errors and stacktraces. Just paths are enough to start leaking information about you and your system that just shouldn't leak from your terminal to the internet.
w1nk··on Show HN: Warp, a Rust-based terminal
You're technically correct here due to some sloppy words, but this isn't the point that everyone here is trying to make. We know our terminals can connect to the internet, we don't want them to do that without being instructed to. If our terminals randomly curl'd websites (as opposed to delivering telemetry to a 3rd party), I'm sure the discussion would be similarly displeased.
w1nk··on Samsung's latest Galaxy A53 is 33% slower than the previous Galaxy A52s
I think you're giving them too much credit by saying they're attempting to create their own experience. I don't believe that's the motivation at all. I don't see any reason to believe Verizon wants to improve the dialer or the messaging app in any way. They're building these things as data exfiltration applications. In the case of some of the apps you can't even remove them. It's absolutely disgusting to be honest.
w1nk··on Show HN: Postgres.js – Fastest Full-Featured PostgreSQL Client for Node and Deno
Hey Jerry!

I'll respond here so we don't have split threads :). I'm also quite familiar with at least the older versions of the node internals (I too maintained a popular db binding for a number of years) and I'm very confused by the way you're positioning the operation of the v8 vm in these 2 scenarios. Sure, the c++ is going to require you to do some sanitizing as you force your data into v8, but as we noted that's inevitable no matter how you slice it. After that though, even once in javascript land, you're still crossing these barriers constantly to allocate data and objects and memory, etc. You don't just end at 'parse in javascript', the virtual machine is going nuts calling into this same c++ codebase. Now maybe in some cases the v8 internals offer some advantages the generic c++ api can't access, but this argument isn't convincing of their existence so far.

My memories of the redis client is different than yours so I'd be quite interested to see those conversations / benchmarks. From what I recall those early advantages in the js redis client were similar to the ones we're seeing here, ie: better pipelining of commands.

As a simple thought experiment, in the scenario you're describing we should see a javascript implementation of a JSON parser to beat the pants off the v8 engine implementation, but this doesn't seem to the case.

w1nk··on Show HN: Postgres.js – Fastest Full-Featured PostgreSQL Client for Node and Deno
I responded to the OP, but I'll add here too for the conversation. Where are these projects that are implementing network protocols, where the nodejs versions are faster than the native ones?

As I noted in my other comment, in -any- of those implementations, you're still going to be required to traverse from libc somewhere to nodejs (even if it's just to read the network data out of the socket and send it to v8). The performance gains would have to either come from a faster (JIT'd) protocol parser, or from eliminating additional FFI calls (that it isn't obvious why they'd exist).

So, would you mind linking to one or some of those projects? I'd love to see what happened to the implementations.

w1nk··on Show HN: Postgres.js – Fastest Full-Featured PostgreSQL Client for Node and Deno
On the surface I'm not sure this explanation passes the smell test. Almost irrespective of how you get the data from your network card into v8 / nodejs, you're going to be crossing c++/v8 boundaries. It's possible that a native binding goes through this expense multiple times, but that's not likely now most of these bindings work (pg at least for sure).

As the author noted elsewhere in thread, the performance gains are mostly coming from prepared statements and pipelining which seems a bit of an apples to oranges benchmark as most of these native drivers will support similar features, just not enable them transparently like this library does.

Out of curiosity, do you have links to these other projects where they have similar benchmarking attempts/results?

w1nk··on Algorithms for Modern Hardware
In my experience, the kinds of use cases for this level of optimization tend to be in fields where computers are used as actual computing devices. So think physics, biology, etc. I'd guess most jobs in the HPC space would allow you to get pretty close to this kind of work in practice, although your job title might still just be 'software engineer' or whatever.

Located in .nl, the oil and gas industry surely has some work that benefits from these kinds of optimizations. ASML probably does enough simulation as well. I'd guess there are probably a handful of financial firms operating on these time scales. Outside of those, the various universities will have groups in this space. I doubt that's an inclusive list, just some areas where I'd expect to find heavily optimized code for specific hardware.

w1nk··on Google mandates workers back to Silicon Valley, other offices from April 4
You mean the language used by the website that gets paid for you to click on it?
w1nk··on TorchRec, a library for modern production recommendation systems
Your point about academia studying different systems than industry rings quite true. Lots of the academic recommender systems are built on datasets and techniques that simply don't scale to real world data/applications.

That said, this pytorch work looks to live more in the realm of application than academia. Building and scaling large neural embeddings is pretty close to industry practice these days and this library at least claims to solve some of the challenges in doing so.

w1nk··on ‘Zero-click’ hacks are growing in popularity
Also, don't forget https://en.wikipedia.org/wiki/Nimda ... all of these were a horror show to deal with on networks of the era..
w1nk··on Google to turn on activity tracking for many users who turned it off
This comment seems unnecessarily aggressive given the code is pretty straightforward to navigate. If you were to read the source code a little further you'd jump into this code, called from OPs referenced function: https://chromium.googlesource.com/chromium/src/+/e51dcb0c148... I'm not sure exactly what kind of 'proof' you're looking for , but this tracking isn't being hidden.
w1nk··on Norton is installing a Cryptocurrency miner called Norton Crypto (NCrypt.exe)
It doesn't just make your computer slow, which is bad enough, it's actively stealing your electricity and converting it into their money. How can that possibly be justified?
w1nk··on Video of Tesla on Autopilot Crashing into Stopped Truck at 75mph
You're misunderstanding what people are saying. You've watched a highly compressed video from a camera sensor that is known to have relatively poor dynamic range (ie: it doesn't see well in the dark when lights are around). The point OP was making (that you completely dismissed) was that our eyes are actually quite good at sensing this scenario. Here's a better version: https://twitter.com/haenschengross/status/147332613675511808...

When you watch the uncompressed version, there are tons of visual cues to a human that there is an object in the way. This is no where near as subtle as the janky video makes it out. You can say you might have missed this at night but either you don't pay enough attention when you're driving, or you're giving tesla a pass here they don't deserve.

w1nk··on Ask HN: Apple revoked developer account for 2.5 years and counting
I have to imagine the answer lies in the interpretation of the rules you quoted in your post: My app is in alignment with it... I've made sure since day one that a "reasonably suspicious" notification is present when the app is monitoring.

Could you elaborate on what your version of this reasonably suspicious notification compared to your competitors actually is?

w1nk··on Apple removes references to CSAM from its child safety webpage
I'm not sure I can agree that it's clear someone spent a lot of time building something they felt was reasonable.

The entire technical underpinnings of this solution rely on essentially neural image embeddings, which are very well known to be susceptible to all sorts of clever attacks. Notice how within a day or two of the announcement of this whole system and it's symbols, people were already finding lots of 'hash' collisions.

In the space of people and places that can train and implement/serve such embeddings, these issues are pretty widely known, which makes it very non-obvious how this happened IMO. Someone that understood all of these issues seems to have directly ignored them.

w1nk··on Graviton2 and Graviton3
They'll definitely have information that traditional CPU designers won't. Check out this talk from Brendan Gregg (he's probably lurking), where he specifically calls this out:

https://www.brendangregg.com/blog/2021-07-05/computing-perfo...

See slide 26 (and the rest ofc :)).

w1nk··on Software company SAP: World-leading through intellectual property theft?
This isn't a commentary on patent law or I.P. which I find mostly absurd, but did the 1-click patent actually have any impact on reality? I remember the internet lighting up with rage about how stupid and obvious it was.

I don't recall e-commerce being hamstrung by it. Do you have any more information on some cases where the patent was actually leveraged?

w1nk··on Gitlab servers are being exploited in DDoS attacks
Given the creators, I'd guess the format is also used in certain machine learning circles as well (or was meant to be at least :)).
w1nk··on OpenWorm
Where else do you imagine the answer would come from?
w1nk··on Nvidia Canvas
It's not a hypothesis though, there's nothing that we can test in it. As presented, it's an assertion that has zero evidence to support it. That's the part I was hoping to get some actual clarification and precision on. When discussing machine learning, bias is a term that has a quantifiable definition in it's different contexts....boring doesn't. It's just FUD to snipe this kind of work with some kind of 'bias' fear without any additional evidence or thought.
w1nk··on Nvidia Canvas
Right, that was the assumption I was alluding to at the end of my comment. That said, it still doesn't fully resolve the question and unfortunately leaves the statement in handwaving territory still. 'boring' isn't really a measurement we can take and discuss super effectively, but we do have actual metrics across visual datasets that span basically all of what you might see as a human.

By chance, are you aware of any research on this topic?

w1nk··on Nvidia Canvas
Would you mind elaborating a bit more on what you mean? It's very fashionable to be concerned about model bias at the moment, but it's not clear to me what the issue you're describing would be? Something like: trees would end up looking too much like the same tree?
w1nk··on Drop millions of allocations by using a linked list (2015)
I never enjoy seeing this line of argumentation pop up when we (as the computing industry) discuss practicalities of data structures and algorithm choices. I've got a bit over twice your time in the industry and one of the things that is still very clearly on an upward walk is the size of our N's (think big O) in all of our applications and across all of our data structures.

I'm not sure what kinds of applications you're building, but if any of your collections contain on the orders of thousands/10s/100s thousands of items, you really should be considering the impact of how you shape that data for consumption inside your application. You hint at the need to do so, arraylists being good enough until they're not and then hashmaps, etc.

I think there is a pretty reasonable line between expecting our engineers and peers to pick proper containers for the data they're consuming without stepping over into purely 'academic' territory. Shutting down the discussions with 'well I've never had to use this' feels a bit icky and not a great way to advance any of the conversation.

w1nk··on Signal Fork with WhatsApp Migration
XMPP never got its story together for mobile clients. Sure there are some configurations of XEPs that will eventually allow you a reasonable configuration that supports multi device, history, media, etc, but for whatever reason, gluing those pieces together into something sane has evaded our community.
w1nk··on Deleting Facebook permanently
It's more than just making a point though. It's having a principled belief in something and standing by it. That's fine if you don't feel that way, but there are lots of us that feel very negatively towards facebook and its impact on society.

It's not about making a point, it's about not actively being part of the thing I see as a problem.

w1nk··on The Pile: An 800GB Dataset of Diverse Text for Language Modeling
Will this dataset be able to produce a model that's actually better than GPT-3? One of the things mentioned in the paper is that the dataset had some buggy filtering applied to it (https://arxiv.org/pdf/2005.14165.pdf, page 9), that minimally impacted benchmarking some, there's a whole section on how they tried to deal with it. The gist though is that a cleaner training run, even on slightly more data, may (should?) actually produce something a bit better.

Does anyone know if OpenAI has retrained/updated gpt-3 yet?

w1nk··on Linux 5.10
I've been working actively on making it work (see ath11k mailing list). We're pretty close now as the connection is stable, but the changes aren't going to make it into 5.10 I'd guess ;). There was a new test branch released overnight that should work for you.
w1nk··on Apache Helix – Near-Realtime Rsync Replicated File System
I think you've overlooked OPs point a bit. You don't need to understand the C/libc internals to be able to operate MySQL (you do need to know it's quirks though). With a JVM application, you're going to need to understand the application level configs, think of something like spark, and if you're doing anything with large amounts of data or high RPS, you're also going to need to understand the JVM internals. The closest analog might be needing to understand the libc allocator for certain usage patterns, and that happens, but it's far more rare than someone needing to tune garbage collection algorithms and parameters. JVM tuning is just a reality of operating in the java ecosystem.
← PreviousPage 2 of 3Next →