I found it hard to get next to reliably treat static content as actually static (and thus cacheable), and it felt like a huge bundle of complexity for such a simple use case.
7,080 karma · joined December 29, 2009
My personal code is at github.com/mwylde. My portfolio is at micahw.com.
Also, check out hnhiring.me: a pleasant interface for viewing the monthly "Who's hiring?" posts.
Email: micah@micahw.com Twitter: @mwylde
[ my public key: https://keybase.io/micahw; my proof: https://keybase.io/micahw/sigs/YzolgIEYaIUyGUkHuc3W1XaS5FLgZPDyZRtllICV_Hs ]
I found it hard to get next to reliably treat static content as actually static (and thus cacheable), and it felt like a huge bundle of complexity for such a simple use case.
In a typical company you'll have jobs, some scheduled, some ad-hoc, at a range of sizes. Most of them won't be cost-effective to run on a GPU instance, so you need a scheduling layer that estimates the size of the job and routes it to the appropriate hardware. But now what if the job is too big to run on your GPU machine? Now we either have to scale up our GPU cluster or retry it on our more flexible CPU cluster.
And this all assumes that your jobs can be transparently run across different executors from a correctness and performance standpoint.
There are niches where this makes sense (we run the same 100TB job every day and we need to speed it up), as well and large and sophisticated internal infra teams that can manage a heterogenous cluster + scheduling systems, but it's not mass-market.
(I have the same workflow, via Obsidian)
The commit history is legitimately insane though: https://github.com/linked-db/linked-ql/commits/master/
The article is about how we represent errors not their control flow (i.e., exceptions).
But then from like 2015-2022 things got crazy. Anyone with a CS degree, or even a boot camp certificate, could immediately get a 200k/year job with little effort. And people started to think this was normal, would last forever. But in fact this was a crazy situation, it absolutely could not last.
I feel for the young people who thought (or were told) that CS degrees were an automatic ticket into the upper middle class. But in reality, there’s no such thing.
Hey HN, I'm hiring engineers for the new Cloudflare Data Platform (https://blog.cloudflare.com/cloudflare-data-platform). We do streaming ingest and processing, managed Iceberg catalogs, and a distributed query engine—all built on R2 and the Cloudflare Edge. We're making it ridiculously easy for Cloudflare customers to build data lakes.
I'm looking for Rust engineers with experience or interest in databases, stream processing engines, and query engines. You'll get to work on incredibly cool tech on a huge scale.
Note: we are hiring for hybrid in one of our engineering hubs (SF/AUS/SEA/NYC/LON/LIS).
If you're interested, shoot me an email (in profile) with subject HN and a brief description of your background.
* Clickhouse
* DuckDB
* BigQuery
* Snowflake
* QuestDBThe em-dash used to be a slightly snooty way for Mac users to announce themselves. Sad that the polarity of perception has reversed.
I’ve been typing em-dashes since I got my first MacBook in 2006 and I’m not going to let the AI companies take my beautiful punctuation away from me.
It's reasonable to be upset about the fact that this is arguably a tax dodge! But all of the other criticism of buybacks apply equally to dividends which no one seems to get upset about. Fundamentally this is the corporation saying it doesn't have a market-beating way to reinvest this capital, and it's giving the money back to its owners to more productively invest.
Netburst lasted a long time as intel was floundering, before Core Duo was released in 2006.
> To ensure continuity for users and fans, as well as to continue building what we regard as an important technology, Dark Inc has sold the assets – the Darklang language, the blog, the hosted service, the Discord, etc, darklang.com, etc – to a new company started by Dark Inc's former employees.
(from https://blog.darklang.com/goodbye-dark-inc-welcome-darklang-...)
In other words, there's a new company (Darklang Inc.) that has purchased the assets of Dark Inc. (for probably relatively little money). This clears the cap table, making it easier for the former employees (now founders) to raise money for the new corporation.
I’m also slightly embarrassed to just now learn that the opening sequence where the speakers and backing structure for the screen are shown looked so real because…it was. They weren’t projecting an image, just turning on lights so you could see back through the perforated metal screen!
But no terms are going to save you from the reality that a failing startup that needs to raise more money will have to accept dilutive terms. You might be able to restrict it, but the alternative is that they can’t raise at all and shut down.
Now members of the original Foundation team have started Antithesis (https://antithesis.com/) to make it easier for other systems to adopt this sort of testing.
I haven't dug deep into this project, so take this with a grain of salt.
ArkFlow is a "stateless" stream processor, like vector or benthos (now Redpanda Connect). These are great for routing data around your infrastructure while doing simple, stateless transformations on them. They tend to be easy to run and scale, and are programmed by manually constructing the graph of operations.
Arroyo (like Flink or Rising Wave) is a "stateful" stream processor, which means it supports operations like windowed aggregations, joins, and incremental SQL view maintenance. Arroyo is programmed declaratively via SQL, which is automatically planned into a dataflow (graph) representation. The tradeoff is that state is hard to manage, and these systems are much harder to operate and scale (although we've done a lot of work with Arroyo to mitigate this!).
I wrote about the difference at length here: https://www.arroyo.dev/blog/stateful-stream-processing
Opinions will differ here, but I think if you're leaving a pre-PMF startup you've created essentially no durable value, and should return nearly all of your equity.
I've heard of startups doing 10 year vesting for founders (with double trigger) to align this better.