HNHacker News
TopNewBestAskShowJobs

jamesblonde

4,745 karma · joined October 13, 2013

submissionscomments
jamesblonde··on Provide agents with automated feedback
I got turned off in the first paragraph with the misuse of the term "back pressure". "back pressure" is a term from data engineering to specifically indicate a feedback signal that indicates a service is overloaded and that clients should adapt their behavior.

Backpressure != feedback (the more general term). And in the agentic world, we use the term 'context' to describe information used to help LLMs make decisions, where the context data is not part of the LLM's training data. Then, we have verifiable tasks (what he is really talking about), where RL is used in post-training in a harness environment to use feedback signals to learn about type systems, programming language syntax/semantics, etc.

jamesblonde··on Ask HN: Distributed SQL engine for ultra-wide tables
If they are exploding categorical variables using OHE and storing the columns - that is the wrong thing to do. You should only ever store untransformed feature data in tables. You apply the feature transformations, like OHE, on reading from the tables, as those transformations are parameterized by the data you read (the training data subset you select).

Reference: https://www.hopsworks.ai/post/a-taxonomy-for-data-transforma...

jamesblonde··on A battle over Canada’s mystery brain disease
And the Wallenberg family.
jamesblonde··on European Commission issues call for evidence on open source
Subsidiarity has been a key building block of the EU and has failed the EU for unexpected reasons. Subsidiarity was pursued for accountability and to make the EU less centralized - decisions should be made at the lowest, most local level possible, with central authorities only stepping in when a task cannot be effectively handled locally. However, it means that here in Sweden govt bodies are all individually moving to Azure, because each one makes that local decision in their best interest. The same thing has happened all over the EU - and very few govt bodies would ever take the risk of investing in using EU cloud or data platforms. We need public procurement to help kickstart life into the Eurostack.
jamesblonde··on Airbus to migrate critical apps to a sovereign Euro cloud
[flagged]
jamesblonde··on Airbus to migrate critical apps to a sovereign Euro cloud
I will be servers as well. Eurostack cloud providers. We are involved in one of these - a large car company doing the same.
jamesblonde··on Airbus to migrate critical apps to a sovereign Euro cloud
They control Europe's digital infrastructure and are able to increase rent to usurous levels (tarrifs!) because Europe is dependent on their digital services. Without digital sovereignty, Europe has no sovereignty and will quickly become a modern colony from which wealth will be extracted.
jamesblonde··on We built another object storage
I agree that this is an anti-pattern for training. In training, you are often I/O bound over S3 - high b/w networking doesn't fix it (.saftensor files are typically 4GB in size). You need NVMe and high b/w networking along with a distributed file system.

We do this with tiered storage over S3 using HopsFS that has a HDFS API with a FUSE client, so training can just read data (from HopsFS datanode's NVMe cache) as if it is local, but it is pulled from NVMe disks over the network. In contrast, writes go straight to S3 vis HopsFS write-through NVMe cache.

jamesblonde··on Cardiac implantable electronic devices' longevity: A novel modelling tool
I have one (top of the line!). Here's how bad the engineers were. For the last 6 months, the device emits 10 audible beeps every 6 hours. I do a lot of customer meetings and public speaking. People would sometimes ask - "what is that noise"? I would say "No idea, but if you wait 8 seconds, it will stop"!

Also, my heart rate would sometimes drop below 40 bpm. Then it would start pacing, which i didn't want and was extremely uncomfortable.

p.s., the reason the battery ran out was because i found a treatment for my condition that works really well through talking globally to experts (i am a computer scientist). I wrote a case study paper about my condition to help others, co-authored by my doctors. https://www.slideshare.net/slideshow/arvc-and-flecainide-cas... 16 years later, the device is still in place, but I will have it removed early next year.

jamesblonde··on Agent design is still hard
Anything sovereign AI or whatever is gone immediately when the mods wake up. Got an EU cloud article? Publish it at 11am CET, it's disappears around 12.30.
jamesblonde··on Peter Thiel sells off all Nvidia stock, stirring bubble fears
See, Peter Thiel is smart. There are enough idiots who will buy his shtick - it's not just maga who get pointed in the direction he wants society to go (serfdom).
jamesblonde··on Cloudflare outage on November 18, 2025 post mortem
Cloudflare tried to build their own feature store, and get a grade F.

I wrote a book on feature stores by O'Reilly. The bad query they wrote in Clickhouse could have been caused by another more error - duplicate rows in materialized feature data. For example, in Hopsworks it prevents duplicate rows by building on primary key uniqueness enforcement in Apache Hudi. In contrast, Delta lake and Iceberg do not enforce primary key constraints, and neither does Clickhouse. So they could have the same bug again due to a bug in feature ingestion - and given they hacked together their feature store, it is not beyond the bounds of possibility.

Reference: https://www.oreilly.com/library/view/building-machine-learni...

jamesblonde··on Google boss says AI investment boom has 'elements of irrationality'
Apart from the free appartment, that's the same as most countries in Europe.
jamesblonde··on Europe's defence spending spree must fund domestic AI, official says
Henna Virkkunen says 10% of investment should be directed to artificial intelligence and quantum computing developed in EU.
jamesblonde··on Peter Thiel sells off all Nvidia stock, stirring bubble fears
He's scarily sane. I am not joking when I say he invented the anti-christ thing as a way to entrench the billionaire class. He's basically saying the anti-christ will be somebody who want to solve the world's problems through collective action. So collective action is bad. We are in such an unbalanced world, that that is the best argument he can come up with for why we should allow such wealth inequality in society.
jamesblonde··on 650GB of Data (Delta Lake on S3). Polars vs. DuckDB vs. Daft vs. Spark
1. Important points that the query is a projection that only returns a fraction of the 650GB that fits in memory. DuckDB is good at streaming larger than memory queries, Polars less mature there. That would show in the results.

2. S3 defaults shouldn't prevent all available threads/cpus from reading the files in parallel, so I would assume that the network bandwidth of the VM (or container) would be the bottleneck.

jamesblonde··on I can't recommend Grafana anymore
I still haven't got my head around how OTEL fits into a good open-source monitoring stack. Afaik, it is a protocol for metrics, traces, and logs. And we want our open-source monitoring services/dbs to support it, so they become pluggable. But, afaik, there's no one good DB for logs and metrics, so most of us use Prometheus for metrics and OpenSearch for logs.

Does OTEL mean we just need to replace all our collectors (like logstash for logs and all the native metrics collectors and pushgateway crap) and then reconfigure Prometheus and OpenSearch?

jamesblonde··on Yann LeCun to depart Meta and launch AI startup focused on 'world models'
I don't think Messi could do it on a wet night in Stoke. Ronaldo could, though.

/s

jamesblonde··on Backpropagation is a leaky abstraction (2016)
I have to be contrarian here. The students were right. You didn't need to learn to implement backprop in NumPy. Any leakiness in BackProp is addressed by researchers who introduce new optimizers. As a developer, you just pick the best one and find good hparams for it.
jamesblonde··on Falling panel prices lead to global solar boom, except for the US
You forgot using your digital infrastructure for extractive rent from your partners, driving them to build their own sovereign digital infrastructure.
jamesblonde··on EuroLLM: LLM made in Europe built to support all 24 official EU languages
The leading European ECommerce Company, Zalando with 50m users, is now using the leading European AI platform, Hopsworks, to power their real-time AI. Zalando are Databricks largest EU customer, but they are using Hopsworks instead for operational AI.

You would never hear it, though, as European IT press only promotes SV startups

https://www.youtube.com/watch?v=u8QFiLhnuFg&feature=youtu.be

Disclaimer, i work at Hopsworks.

jamesblonde··on The last European train that travels by sea
I went on this train as well back in the late 1990s. It was a surreal experience that you get off the train on a ferry!
jamesblonde··on A sharded DuckDB on 63 nodes runs 1T row aggregation challenge in 5 sec
It would undercut all their higher level services - like DynamoDB, CosmosDB, etc.

Databases would suddenly go BRRR in the cloud and show up cloud-native (S3) based databases for the high latency services they are.

jamesblonde··on A sharded DuckDB on 63 nodes runs 1T row aggregation challenge in 5 sec
With 2 modern NVMe disks per host (15 GB/s) and pcie 5.0, it should only take 15s to read 30 TB into memory on 63 hosts.

You can find those disks on Hetzner. Not AWS, though.

jamesblonde··on Mosquitoes discovered in Iceland for the first time
Ireland is still pretty much free of mosquitoes. I think it is the wind and exposure that keeps them out
jamesblonde··on Trump pardons convicted Binance founder
Do you think they will let the Democrats take control given the risk to them if they take control? I see Gerrymandering after the supreme court annuls the voting rights acts. And then more shennanigans for a third term.
jamesblonde··on Trump pardons convicted Binance founder
Whataboutism. Has to be called out.
jamesblonde··on AWS outage shows internet users 'at mercy' of too few providers, experts say
It's a market regulation failure. Which results in a failed market, with the cloud infra provider also providing data services. 20 years ago, there were 20+ widely used operational databases. Now, it's like DynamoDB with like half the market.
jamesblonde··on K8s with 1M nodes
RonDB uses a non-blocking 2PC algorithm - commits in memory, and then does a group commit of transactions to disk every 500ms. This means it can handle insane write throughput, as well as read throughput. However, if both your DB nodes fail, you could lose 500ms of data - which is not the end of the world for k8s. Normally, you would locate DB nodes in different AZes, reducing the probabilty of correlated failures.
jamesblonde··on K8s with 1M nodes
Is it throughput and latency that are the etcd bottlenecks? Our database, RonDB, is an in-memory open-source database (a fork of MySQL Cluster). We have scaled it to 100m reads/sec on AWS hardware (not even top of the line). Might be an interesting project to implement an open-source etcd shim on top of it?

Reference: https://www.rondb.com/post/100m-key-lookups-sec-with-rest-ap...

← PreviousPage 2 of 34Next →