eG Monitoring
 

Measures reported by KafkaNetworkTest

Kafka uses a binary protocol over TCP. The protocol defines all APIs as request response message pairs and all messages are size delimited. This test reports the performance of the Kafka network where the transactions between producers, consumers and Kafka clusters (brokers) take place.

Outputs of the test: One set of results for the target Apache Kafka Message System.

The measures made by this test are as follows:

Measurement Description Measurement Unit Interpretation
requestQueueSize Indicates the size of the request queue. MB

A congested request queue will not be able to process incoming or outgoing requests.

responseQueueSize Indicates the size of the response queue. MB

The response queue is unbounded.

A congested response queue can result in delayed response times and memory pressure on the broker.

expiredConnectionsKilled Indicates the total number of connections disconnected, across all processors. Count

The disconnection is due to a client not being re-authenticated and using the connection beyond its expiration time for anything other than re-authentication.

cntrlPlaneExprdCnectnkll Indicates the number of expired connections that were disconnected on the control plane. Count

A very low value is required for this measure.

memoryPoolUsed Indicates the number of bytes currently allocated out of the pool and still not returned. MB

 

temporaryMemoryFetch Indicates the temporary memory used for message format conversions and decompression during Fetch. MB

 

temporaryMemoryProduce Indicates the temporary memory used for message format conversions and decompression during Produce. MB