eG Monitoring
 

Measures reported by KafkaConFetcTest

The consumer periodically sends a request to a Kafka broker in order to fetch data from it. The consumer application then receives a number of records in a response, processes them and asks for more in the form of another request.

This test monitors the number of records consumed during each fetch request raised by the consumer and also identifies the average time taken for each request. Using this test, the administrators can rapidly capture real/probable problem conditions during fetch process and swiftly resolve them, so as to ensure the high availability of the target Apache Kafka Message System.

Outputs of the test: One set of results for the target Apache Kafka Message System.

The measures made by this test are as follows:

Measurement Description Measurement Unit Interpretation
bytesConsumedRate Indicates the average consumed data. MB/Second

 

fetchLatencyAvg Indicates the average time taken for a fetch request. Milliseconds

A very high value is indicative of the inability of the system to fetch requests.

fetchRate Indicates the number of fetch requests. Requests/sec

 

fetchSizeAvg Indicates the average number of bytes fetched per request. MB/request

 

fetchThrottleTimeAvg Indicates the average throttle time. Seconds

A very low value is required for this measure.

recordsConsumedRate Indicates the average number of consumed records.

Records/sec

 

recordsLagMax Indicates the maximum lag in terms of number of records for any partition.

Number

 

recordsLeadMin Indicates the minimum lead in terms of number of records for any partition.

Number

 

recordsPerRequestAvg Indicates the average number of records in each request.

Records/sec