eG Monitoring
 

Measures reported by KafkaServerTest

Kafka is distributed data infrastructure, which implies that there is a node (broker) that can be duplicated across a network such that the collection of all of those nodes functions together and constitute a single Kafka cluster. This test reports the performance of operational broker metrics aggregated across the cluster, and per broker or per topic.

Outputs of the test: One set of results for the target Apache Kafka Message System.

The measures made by this test are as follows:

Measurement Description Measurement Unit Interpretation
leaderCount Indicates the number of replicas for which this broker is the leader. Count

 
partitionCount Indicates the number of partitions in the broker. Count

 
offlineReplicaCount Indicates the number of offline replicas on a live broker. Count

This is equivalent to the number of Topic Partition log on the bad log directories of the broker.
failedIsrUpdates Indicates the number of failed ISR update in Zookeeper. Number

A very low value is required for this measure.
reassigningPartitions Indicates the number of reassigning leader partitions on a broker. Number

 
underReplicatedPartition Indicates the number of partitions that have not been fully replicated in the follower replicas. Number

 
underMinIsrPartition Indicates the number of partitions under the minimum In-Sync Replica (ISR) count. Count

The ISR count indicates the set of replicas that are up-to-date with the leader.
isrShrinks Indicates the rate at which the number of ISRs are decreasing in the broker. Number

 
isrExpands Indicates the rate at which the number of ISRs are decreasing in the broker. Number

 
atMinIsrPartitionCount Indicates the number of partitions with only minimum number of In-sync replicas remaining in the ISR set. Count

 
fetchQueueSize Indicates the size of the queue for Fetch. MB

 
produceQueueSize Indicates the size of the queue for Produce. MB

 
requestQueueSize Indicates the size of the queue for requests. MB