HNHacker News
TopNewBestAskShowJobs

olavgg

1,790 karma · joined May 8, 2013

Founder of IntelliStream

https://intellistream.ai https://no.linkedin.com/in/olavgjerde http://olavgg.com

submissionscomments
olavgg··on Mini NASes marry NVMe to Intel's efficient chip
I experimented with spindowns, but the fact is, many applications needs to write to disk several times per minute. Because of this I only use SSD's now. Archived files are moved to the Cloud. I think Google Disk is one of the best alternatives out there, as it has true data streaming built in the MacOS or Windows clients. It feels like an external hard drive.
olavgg··on Foundation DB Record Layer SQL API
There is a company delivering a data platform for the Industry 4.0 named Cognite based in Oslo, Norway that migrated from Google BigQuery to their own database on on top of FoundationDB.

The video about it is available here: https://2023.javazone.no/program/85eae038-49b5-4f32-83c6-077... After watching, my thoughts were; why didn't you just use Clickhouse?

olavgg··on Waiting for Postgres 18: Accelerating Disk Reads with Asynchronous I/O
And no ECC memory?
olavgg··on Redis is open source again
Valkey has RDMA support, which offers significant performance improvements.
olavgg··on What If We Could Rebuild Kafka from Scratch?
How many of the Apache Kafka issues are adressed by switching to Apache Pulsar?

I skipped learning Kafka, and jumped right into Pulsar. It works great for our use case. No complaints. But I wonder why so few use it?

olavgg··on ClickHouse gets lazier and faster: Introducing lazy materialization
Actually this is not important. Because they need to make a living, and with that they have to make some functonality of ClickHouse propritary.

You can scale the pure open source project really far. And if you need more, you do have money to pay for it.

People need to stop thinking that open source is free leech. Open source is about sharing knowledge and building trust between each other. But we are still living in a business world where we are competing.

olavgg··on An intro to DeepSeek's distributed file system
That is true, though the implementation is weird.

I mount my nfs shares like this: sudo mount -t nfs -o nolocks -o resvport 192.168.1.1:/tank/data /mnt/data

-o nolocks Disables file locking on the mounted share. Useful if the NFS server or client does not support locking, or if there are issues with lock daemons. On macOS, this is often necessary because lockd can be flaky.

-o resvport Tells the NFS client to use a reserved port (<1024) for the connection. Some NFS servers (like some Linux configurations or *BSDs with stricter security) only accept requests from clients using reserved ports (for authentication purposes).

olavgg··on Andrej Karpathy on the State of Web Development
Google Docs is something I would implement with vanilla js.
olavgg··on Andrej Karpathy on the State of Web Development
Web development is super simple as long you use a mature stack. Just use HTML/Server side rendered templates, CSS and Vanilla JS. Then you need a mature backend framework, Spring Boot, Rails, Django and then you need a database, SQLite, MySQL or PostgreSQL.

With this, you can create powerful web applications, with minimal dependencies and a working back button for browsers.

olavgg··on Microsoft Fails to Support MS SQL Server for Django
SQLite supports online backup https://www.sqlite.org/backup.html

You can also use Litestream to create snaphots.

olavgg··on Microsoft Fails to Support MS SQL Server for Django
But you are not supposed to tell them that you use another SQL db, you use a file as it simplies things and saves money. For example, you do not need to expose anything over the network, you do not need to setup service account and password and data access is embedded in your application which improves latency. And backup is a lot easier as you just create a daily dump from your application that writes to a backup folder and tell IT to backup that folder. People have been saving things to files for decades, and IT shouldn't worry about the data structure in that file.

This is not a lie, its about avoiding politics and fights. If they ask you to use MSSQL instead of a file, you politely ask them; why they want to overengineer and delay application development.

I've been doing this for years. It works.

olavgg··on But how to get to that European cloud?
I agree with this. It doesn't make sense to have these low salaries. You want the best people that make a difference, business is like sport. Your team competes with other teams.

You can't expect to get Lionel Messi on your team with just €70k, but for €200k you get hell of a bargain.

olavgg··on Microsoft Fails to Support MS SQL Server for Django
In those cases I tell them that I store everything in a file(sqlite) and IT can easily backup that file. If IT needs data access, its available in the application with csv/spreadsheet export.

I promise you, they will be super happy with that!

olavgg··on New Zealand's $16B health dept managed finances with single Excel spreadsheet
I have seen projects being implemented in SAP, by 20 people, that a single junior software developer could do better solo in the same time frame.
olavgg··on New Zealand's $16B health dept managed finances with single Excel spreadsheet
I've seen several multi billions companies running big processes in Excel. No automation, just put more human workers on the spreadsheets.

I understand the decision though, because investing in a IT system is so friggin expensive, require 10x more people and there is a huge lack of talent to deliver something on time, that works, and actually saves money.

olavgg··on MySQL at Uber
On big reason why many choose MySQL over Postgresql is this MySQL extension https://github.com/vitessio/vitess
olavgg··on Ask HN: What intelligent forums exist outside of HN?
One of my favorites: https://forums.servethehome.com
olavgg··on Software development topics I've changed my mind on
One thing that I have never been more sure about after 20 years as a software developer, is that Hibernate is awesome! Seriously, it saves me ton of time and tinkering. It has support for native queries, and it is simple to transform your custom query into JPA entities. Using Hibernate has never been easier with the introduction of LLM, tell it what it needs to do, and see beautiful Hibernate examples code.

In my Spring Boot applications I log every SQL that is generated, and quickly spot unoptimizations, like lazy loading of entities instead of using join.

How ORM's behave in other languages and frameworks, like Python, Go, Rust is probably another story.

olavgg··on ZFS 2.3 released with ZFS raidz expansion
L2ARC has had persistence support for a few years now.
olavgg··on Euro-cloud provider Anexia moves 12,000 VMs off VMware to homebrew KVM platform
That depends, on a modern Epyc, you can easily run a few thousand VM's on one system.
olavgg··on Swc4j: SWC for Java
Javascript bundling for Spring Boot applications?
olavgg··on Kuvasz-streamer: open-source CDC for Postgres for low latency replication
How does it compare versus Debezium?
olavgg··on Rails for everything
The biggest difference here is that Spring Boot has the errors in a seperate object BindingResult. If you use Thymeleaf, this is smoothly integrated and you just write: <p th:if="${#fields.hasErrors('comment')}">Invalid Comment</p>

Grails Framework (Spring Framework more like Rails) integrates errors directly into the domain model, so if you have a domain class Person, it was extended with person.errors property.

olavgg··on Databases in 2024: A Year in Review
I would use it if it supported backup/restore over unix pipes / ssh.
olavgg··on After 3 Years, I Failed. Here's All My Startup's Code
Not really true, but dealing with 50x 10 USD invoices is not something I want to waste time on. Is there a business that can bundle different services with just one invoice? Or do I still have to use AWS, Azure, GCloud?
olavgg··on React 19
I have built large and complex front-end applications with jQuery. It worked great, no complaints.
olavgg··on OpenZFS deduplication is good now and you shouldn't use it
You can also use DragonFlyBSD with Hammer2, which supports both online and offline deduplication. It is very similar to ZFS in many ways. The big drawback though, is lack of file transfer protocols using RDMA.

I've also heard there are some experimental branches that makes it possible to run Hammer2 on FreeBSD. But FreeBSD also lacks RDMA support. For FreeBSD 15, Chelsio has sponsored NVMe-oF target, and initiator support. I think this is just TCP though.

olavgg··on MVCC – the part of PostgreSQL we hate the most (2023)
The default is 8kb, but it can be recompiled for 4kb-32kb, I actually prefer 32kb because with ZSTD compression, it will most likey only use 8kb after being compressed. Average compress ratio with ZSTD, is usually between 4x-6x. But depending on how your compressable you data is, you may also get a lot less. Note that changing this block size, will require initialization of a new data file system for your Postgres database.
olavgg··on Why does everyone run ancient Postgres versions?
The PostgreSQL team releases a data incompatible format every year. Do they really need to break the data format every year? In my opinion, the release model for PostgreSQL should be refactored. Breaking stuff is no fun for users, please stop doing that if you are a software developer. And if you have to, make it autonomous for the user.
olavgg··on Ryzen 9000X3D performance according to MSI
Which is basically memory bandwidth problem, which a large L3 cache helps a lot with. I've seen the same things with ClickHouse, having a larger L3 cache and fewer cpu cores can increase performance significantly.
← PreviousPage 3 of 22Next →