Hacker News Reader

I've been following this project for a long time, but I have to ask what are the advantages over using Kafka Connect Sinks?

https://docs.confluent.io/current/connect/kafka-connect-s3/i...

View on HN

Looks like the S3 connector was released in 2017. So if you wanted this functionality before then, secor was a good option: https://www.confluent.io/blog/apache-kafka-to-amazon-s3-exac...

It also supports going to other cloud object stores (other than S3).

Yup, there was definitely a reason to consider Secor before 2017. Part of the reason I'm familiar with Secor in the first place.

Just to be clear, there are dozens of Kafka Connect Sinks and Sources, and finding Kafka Connect Sinks for other blob storage solutions should be easy. If you can't the KC framework makes it pretty easy to develop your own.

I don't think there's a good connect sink for GCS available under a non commercial license

https://docs.confluent.io/current/connect/kafka-connect-gcs/...

> You can use this connector for a 30-day trial period without a license key.

Ugh, you're right...

Reply on news.ycombinator.com