HNHacker News
TopNewBestAskShowJobs

jacobprall

89 karma · joined August 5, 2021

submissionscomments
jacobprall··on Show HN: I made tool that let's you see everything about any website
I enjoyed the UI, cool aesthetic.
jacobprall··on Discussion on why SQLite is gaining popularity [audio]
It's a matter of use case - for simple web page or even a lightweight client-side app, maybe too big. But for tool with heavy data processing, I could see it being quite useful.
jacobprall··on Pull data from 100s of sources in 1 Python statement with in-memory ELT library
Thanks for the feedback!
jacobprall··on Navigating the Data Engineering Landscape in 2024
Thanks! We're hoping it will help data engineers survive what will be a wild 2024 for the industry!
jacobprall··on Navigating the Data Engineering Landscape in 2024
Practical tips to help you stay afloat in this fast-moving discipline.
jacobprall··on A Technical Dive into PostgreSQL's replication mechanisms
Youre right, real-time is generally achieved by streaming CDC data with logical replication via a connector server to Kafka (Debezium does this) or a different queue to be picked up by consumers downstream.

Supabase does a great job of abstracting that part away with their real-time feature set

jacobprall··on A Technical Dive into PostgreSQL's replication mechanisms
That's an excellent point. My statement was unnecessarily confusing. I've changed it to simply reference another benefit of the WAL - optimizing I/O operations. That would make a good blog post in and of itself :D
jacobprall··on A Technical Dive into PostgreSQL's replication mechanisms
Supabase realtime (especially if you want a managed backend) or other streaming CDC setups (like Decodable, which is Flink/Debezium under the hood) are also great choices for logical replication. Streaming tech will continue to get more cost-effective and simpler to implement in the coming year(s).

I should note: I haven't used Decodable in production yet, I'm just a fan of Flink :)

jacobprall··on A Technical Dive into PostgreSQL's replication mechanisms
Should be relatively affordable for modest deployments - I would categorize Neon and Airbyte as "bang-for-your-buck" products (Airbyte vs Fivetran, + Neon's solid free tier).
jacobprall··on A Technical Dive into PostgreSQL's replication mechanisms
Looks cool. I appreciate the support for all replica identity settings!
jacobprall··on A Technical Dive into PostgreSQL's replication mechanisms
This is a guide to logical replication in Postgres where I break down some of the internal components of the database to explain CDC. If you've ever wondered how WAL buffers work, or what happens when a transaction is executed, check it out!