Postgres Task Queues: The Secret Weapon Killing Specialized Queue Services?

fforward.ai

5 pointscamwest3 comments

Do you believe Postgres task queues can replace something as robust as Kafka?

What use-cases would you recommend to use it for?

No definitely not. Kafka is for LinkedIn scale. Postgres is for everyone else.

Quick anecdote. I remember a friend who joined Shopify relatively early. He took ALL their data from many different services (analytics, Kafka etc) and loaded into Postgres on his laptop so he could query it efficiently.

It's amazing how over-engineered some startups are.

haha thank you

I can tell you dozens of similar anecdotes too

Kafka is very difficult to manage and it's better to avoid early for sure

Reply on news.ycombinator.com