HNHacker News
TopNewBestAskShowJobs

germanosin

55 karma · joined December 10, 2020

Senior Solutions Architect at Provectus, AWS-certified. Strong track record of building Big Data & ML/AI solutions. 15+ years of experience.
submissionscomments
germanosin··on Kafbat UI – Resurrected Kafka UI from the Original Core Team
We brought Kafbat UI back to life — a clean, modern UI for Apache Kafka (kafka-ui), originally built by the core team that created the widely used Kafka tools you may have seen before.

Key features:

Built by the original maintainers

Instant cluster introspection and topic browsing

Zero-config local startup (Docker support included)

Actively maintained & open source

GitHub: https://github.com/kafbat/kafka-ui

We’d love your feedback and contributions — let’s build the Kafka UI we all wanted back.

germanosin··on Show HN: Kafbat UI for Apache Kafka v1.2 is out
This is truly the missing piece for any streaming infrastructure, bringing much-needed observability to all Kafka users!
germanosin··on Show HN: Kafbat UI for Apache Kafka v1.0 is out
Thanks for your warm words!
germanosin··on Show HN: Open source data discovery and observability platform
You can find source code of our platform here: https://github.com/opendatadiscovery/odd-platform

We are 100% opensource, not only architecture but also implementation

germanosin··on Show HN: Open source data discovery and observability platform
No, this was a role based access control and enterprise databases support.
germanosin··on Show HN: Open source data discovery and observability platform
Hi Cilvic, This is an opensource product. You could use it for free. If you have any questions or need any assistance we would be happy to help you and the same time we hope you'll help our product with your feedback and real-world use cases.
germanosin··on Show HN: Open source data discovery and observability platform
You can find detailed documentation here https://docs.opendatadiscovery.org/. We would love to hear any feedback or questions you may have about our product! Here is a link to our Slack community https://go.opendatadiscovery.org/slack
germanosin··on Show HN: Open source data discovery and observability platform
Hi, we're the team behind this product! We updated our demo to include social logins so that spam doesn't get through. There are no logs being collected, and we're not selling this information either - if you don’t want the online version of it just head over https://github.com/opendatadiscovery/odd-platform/tree/main/... locally using docker-compose
germanosin··on Show HN: UI for Apache Kafka
UI for Apache also provides full support for Kafka Connect
germanosin··on Show HN: UI for Apache Kafka
UI for Apache Kafka supports OIDC (https://github.com/provectus/kafka-ui/blob/master/guides/SSO...) and basic authentication (https://github.com/provectus/kafka-ui/blob/683ab231f436893b3...)
germanosin··on Show HN: UI for Apache Kafka

  Hi, db3pt0
  Thanks for detailed feedback!

  - The CleanupPolicy
  fixed issue 925 (https://github.com/provectus/kafka-ui/issues/925)

  - When viewing Cluster -> Topic -> Consumers, it seems like far more is being loaded than just consumer groups for that particular topic. 
  It takes much longer to load than, e.g., Kowl does for pulling the same information
  There is only one way to filter consumer groups by topic, get all consumer groups, enrich it with current members, committed offsets, and then filter them by topic.
  If you have a lot of consumer groups, this might take time to do it. We are thinking on this issue, and will try to improve it in the next versions.
  (https://github.com/provectus/kafka-ui/issues/927)

  - Similar feedback for when clicking on an individual consumer group (example URL path: "/ui/clusters/dev/consumer-groups/my-group"). It takes a very long time to load
 This looks rather strange. For single consumer we are getting consumer group description and then enrich it with topic info (end offsets). This works fast enough.

  - If any permissions issues are encountered while loading the individual consumer group, the entire request fails. That wouldn't necessarily be an issue, but it is when you're loading all consumer groups, and not just the one requested
  Thx for describing this. We created issue for this. (https://github.com/provectus/kafka-ui/issues/928)


  - I don't see any docs on how to access a topic that is secured with certificates (Kowl's relevant config [2])
  You have to pass ssl config stores to kafka client (we'll add docs. in the next versions https://github.com/provectus/kafka-ui/issues/929)

  KAFKA_CLUSTERS_0_PROPERTIES_SSL_KEYSTORE_LOCATION = /var/private/ssl/kafka.server.keystore.jks
  KAFKA_CLUSTERS_0_PROPERTIES_SSL_KEYSTORE_PASSWORD = test1234
  KAFKA_CLUSTERS_0_PROPERTIES_SSL_KEY_PASSWORD = test1234
  KAFKA_CLUSTERS_0_PROPERTIES_SSL_TRUSTSTORE_LOCATION = /var/private/ssl/kafka.server.truststore.jks
  KAFKA_CLUSTERS_0_PROPERTIES_SSL_TRUSTSTORE_PASSWORD = test1234

  - If a schema registry uses a self-signed certificate (or one signed by a corporation's CA), there's no way to pass the certificate through a config or skip validation (Kowl's relevant config [3]). As it is, you get a 500 error in the API call, but the UI doesn't show an error

  Same as above (https://github.com/provectus/kafka-ui/issues/930)
  KAFKA_CLUSTERS_0_PROPERTIES_SSL_TRUSTSTORE_LOCATION = /var/private/ssl/kafka.server.truststore.jks
  KAFKA_CLUSTERS_0_PROPERTIES_SSL_TRUSTSTORE_PASSWORD = test1234
germanosin··on Show HN: UI for Apache Kafka
Could you please create an issue in the repo with detailed description / logs. By design it should work.
germanosin··on Show HN: UI for Apache Kafka
We had a discussion with Apache team member according the name. Their main concern was that name should contain not Kafka but Apache Kafka. So they are ok with our current product name "UI for Apache Kafka"
germanosin··on Show HN: UI for Apache Kafka
You could start with documentation here https://github.com/provectus/kafka-ui/blob/master/guides/AWS.... Feel free to create an issue if you have any questions.
germanosin··on Show HN: UI for Apache Kafka
This is mentioned in my medium profile. If you think that my comparison is not objective feel free to mention it on comment there)
germanosin··on Show HN: UI for Apache Kafka
Yahoo CMAK is mostly focused on ops, UI for Apache Kafka is mostly for devs, providing Kafka ecosystem integration and observability.
germanosin··on Show HN: UI for Apache Kafka
Sure, This fully support AWS MSK including AWS IAM authentication, Glue schema registry and AWS Kafka Connect
germanosin··on Show HN: UI for Apache Kafka
Btw I have an article comparing it with confluent web GUI https://towardsdatascience.com/overview-of-ui-tools-for-moni...
germanosin··on Show HN: UI for Apache Kafka
Hi, yes exactly. Backend is on Java + spring boot webflux, because of Kafka most mature client and frontend react + typescript.