Centralized Monitoring and Troubleshooting for Kafka Clients

Kafka clients collect a lot of metrics that can be used for troubleshooting. When you have ten clients in a cluster, it's already hard to coordinate collection of the metrics. When you have thousands of clients, it's really hard. Many cluster operators do not have control over the clients, and the lack of consistent telemetry across clients is an operational gap.  

  KIP-714 improves monitoring and troubleshooting of client performance by enabling clients to push metrics to brokers. The cluster operator can define subscriptions for the metrics they want to collect and from which clients, and then the clients push the metrics. The KIP also standardizes metrics so that metrics from different client implementations can easily be aggregated together.  

  Come and hear how this KIP makes it easy to identify problematic clients, and watch a live demo showing how you can use it with your Apache Kafka cluster.