|
Measures reported by KafkaConsLagTest
Kafka Consumer lag indicates the lag between Kafka producers and consumers. If the rate of production of data from producers far exceeds the rate at which it is getting consumed by the consumers, then the consumer groups will exhibit a lag. This test helps the administrators to monitor how much lag there is between Kafka producers and consumers.
Outputs of the test: One set of results for each consumer group in the target Apache Kafka Message System.
Descriptor: Consumer group
The measures made by this test are as follows:
| Measurement |
Description |
Measurement Unit |
Interpretation |
| currentOffSet |
Indicates the number of current offsets. |
Number |
An offset is a simple integer number that is used by Kafka to maintain the current position of a consumer.
If current offset is positive - that means that there is a lag. In most cases, if your Kafka Producer is actively producing messages and the Kafka Consumers are actively consuming, you will have a small lag here. This is expected. The problems start when the lag is significant or is constantly growing. That means that the data is not processed fast enough.
|
| endOffSet |
Indicates the number of end offsets. |
Number |
Inside the Brokers, data is stored in one or more Topics, and each Topic consists of one or more Partitions. When writing data a Broker actually writes it into a specific Partition. As it writes data it keeps track of the last “write position” in each Partition. This is called Latest Offset, also known as Log End Offset. Each Partition has its own independent Latest Offset.
|
| lag |
Indicates the number of lags between Kafka producers and consumers. |
Number |
A very low value is required for this measure.
Use the detailed diagnosis of this measure to know the Client ID and Host details.
|
| lagPercent |
Indicates the percentage of lags between Kafka producers and consumers. |
|
A very low value is required for this measure.
|
|