HNHacker News
TopNewBestAskShowJobs

chicagobuss

60 karma · joined August 28, 2017

[ my public key: https://keybase.io/chicagobuss; my proof: https://keybase.io/chicagobuss/sigs/ufxlr0-VvERrONawszzM5bFy_nP-1hw5UfqqoXrSfBI ]

https://chicagobuss.dev

submissionscomments
chicagobuss··on Ask HN: Who is hiring? (October 2025)
Duckbill engineering is hiring a full-time ONSITE senior data engineer in downtown San Francisco. We WFH Tuesdays and Thursdays.

We're tackling the hardest finops challenges for the biggest enterprise customers head-on and have a killer team along with the advantage of the established and industry-leading DuckBill Group.

Help shape the leading edge of an entire industry with us while we're still just at seed stage and under 6 engineers!

Comp range is generous on the equity and between 180k and 210k base depending on seniority. We're cooking with flask, react, postgres, clickhouse, parquet and airflow on AWS at the moment.

---

Apply here: https://www.duckbillgroup.com/careers/

Or email: careers@duckbillhq.com

chicagobuss··on Ask HN: Who is hiring? (September 2025)
Duckbill engineering is hiring a full-time ONSITE full-stack senior SWE in downtown San Francisco. We WFH Tuesdays and Thursdays.

We're tackling the hardest finops challenges for the biggest enterprise customers head-on and have a killer team along with the advantage of the established and industry-leading DuckBill Group.

Help shape the leading edge of an entire industry with us while we're still just at seed stage and under 6 engineers!

Comp range is generous on the equity and between 180k and 200k base depending on seniority. We're cooking with flask, react, postgres, and clickhouse on AWS at the moment.

---

Apply here: https://www.duckbillgroup.com/careers/

Or email: careers@duckbillhq.com

chicagobuss··on From BigQuery to Lakehouse:How We Built a Petabyte-Scale Data Analytics Platform
this is awesome. I especially appreciate the detailed testing notes.
chicagobuss··on Introducing S2
Peering is an option as well but it's a whole different ballgame of complexities to set up vs. private link
chicagobuss··on Trump wins presidency for second time
I'm surprised this take isn't gaining more ground in these discussions.

people keep talking about how "this is what all these Americans want" - bologna I say. They're just voting how they've been programmed to believe.

Find me a Trump supporter that has only researched him from first-hand credible sources and has not been influenced by friends, family, social media, or mainstream media. I would be very surprised if any person like this exists.

chicagobuss··on Trump wins presidency for second time
last time the checks and balances were more prepared to handle (block) him.

this time, they're primed to enable and embolden their plans (see project 2025).

I don't expect these four years to be anything like the last time. I legitimately won't be surprised if this is the last somewhat-normal presidential election in the united states

chicagobuss··on Trump wins presidency for second time
Wonder if you'll regret your vote when we find ourselves headed more than ever towards a true fascist dictatorship.
chicagobuss··on Trump wins presidency for second time
Assuming you're arguing in good faith, here is the transcript from someone who was in the room with Trump when he was saying all of this:

> He's looking for obedience. This is the thing that shocks him about American generals and continues to shock him, is that they swear an oath to the Constitution, not to the president. That's what he's looking for, personal loyalty. And we know that from many other discussions we have heard around him.

chicagobuss··on Trump wins presidency for second time
just curious if you think that the rhetoric from trump and his followers is not only hurtful, but also incredibly violent.

like how he said he wishes he had Hitler's generals so he could just have democrats or others who disagree with him executed

chicagobuss··on Pinecone raises $100M Series B
2021
chicagobuss··on 1.1B Taxi Rides Using OmniSciDB and a MacBook Pro
Agreed. I'm also a bit frustrated that he never tuned vertica in his test of it - he just loaded the data into the default superprojection and queried it like that. Nearly all of vertica's power comes from its concept of projections - just like normal DBs benefit from indexes. I'd really like to see how it performs to these other systems once it's been tuned properly because in my experience it's always been the fastest DB I've ever worked with.

https://www.vertica.com/docs/9.2.x/HTML/Content/Authoring/Gl...

https://www.vertica.com/docs/9.2.x/HTML/Content/Authoring/Ad...

chicagobuss··on Apache Kafka Goes 1.0
Of course, the key to any successful implementation of end-to-end exactly-once processing lies in the fact that you USE the kstreams APIs - including all semantics around "consumption is completed up to offset X"
chicagobuss··on Apache Kafka Goes 1.0
Absolutely, we used store-and-forward semantics when I used Kafka at a previous company to guarantee zero message loss (for data getting into kafka). Now that kafka streams provides exactly once semantics, you're in an even better spot to achieve this.
chicagobuss··on Streams: a new general purpose data structure in Redis
Genuine question - Why does everyone seem to think running a zookeeper cluster is so hard? You can run it on three small VMs and basically forget about it. We didn't have any zookeeper experience at my last startup before we started using it for Kafka and we used a very simple puppet module to install it on three instances in each of our AWS regions. It really never gave us many problems in the several years since.

Also, all the tooling around it is quite mature - there are great monitoring and management tools for probing at the internals which helped when we were dealing with more exotic kafka surgery.

chicagobuss··on Streams: a new general purpose data structure in Redis
re: client support - I dunno, this seems like a pretty comprehensive list to me? I mean, there's even a rust client: https://cwiki.apache.org/confluence/display/KAFKA/Clients
chicagobuss··on KSQL: Open Source Streaming SQL for Apache Kafka
Hmm. I don't see that at all. Aurora is a way to query data in S3. This is a way to query Kafka streams in real time.
← PreviousPage 2 of 2