eG Help

A Kafka cluster consists of one or more servers (Kafka brokers). Each Broker can have one or more topics. A topic is a category or feed name to which records are published. Kafka topics are divided into a number of partitions, each partition can be placed on a single or separate machine to allow for multiple consumers to read from a topic in parallel.

This test helps the administrators to monitor the request from producers, consumers and broker followers to the brokers, ensuring that the target Apache Kafka Message System is communicating efficiently and resolve potential contentions, if any.

Outputs of the test: One set of results for the target Apache Kafka Message System.

Measurement	Description	Measurement Unit	Interpretation
dataIn	Indicates the rate at which data sent from producers is consumed by the broker.	MB/sec
totalProduceRequests	Indicates produce request rate.	Requests/Sec	A very low value is required for this measure.
messagesIn	Indicates the rate at which individual messages are consumed by the broker.	Messages/sec
invalidMessageCrcRecords	Indicates the message validation failure rate due to incorrect Cyclic Redundancy Checks (CRC).	Requests/Sec	A very low value is required for these measures.
failedFetchRequests	Indicates the fetch request rate for requests that failed.	Requests/Sec	A very low value is required for these measures.
replicationDataOut	Indicates the rate at which data is sent from the broker to other brokers.	MB/sec	This metric is useful to monitor if the broker is a leader for a group of partitions.
failedProduceRequests	Indicates the produce request rate for requests that failed.	Requests/Sec	A very low value is required for this measure.
replicationDataIn	Indicates the rate at which data sent from other brokers is consumed by the follower broker.	MB/sec
invalidOffsetRecords	Indicates the message validation failure rate due to non-continuous offset or sequence number in batch.	Records/sec	A very low value is required for this measure.
dataOut	Indicates the rate at which data is fetched and read from the broker by consumers.	MB/sec
fetchMessageConversions	Indicates the number of fetch message conversions per second for the broker.	Messages/sec
dataRejected	Indicates the aggregate rejected byte rate for the topic.	MB/sec	A very low value is required for these measures.
noKeyCompactedTopicRecor	Indicates the message validation failure rate due to non key specification for compacted topic	Records/sec	A very low value is required for these measures.
produceMessageConversion	Indicates the number of produce message conversions for the broker.	Messages/sec
reassignmentDataOut	Indicates the outgoing byte rate of reassignment traffic.	MB/sec
totalFetchRequests	Indicates the fetch request rate.	Requests/sec
reassignmentDataIn	Indicates the Incoming byte rate of reassignment traffic.	MB/sec
invalidMagicNumberRecord	Indicates the message validation failure rate due to invalid magic number.	Records/sec	A very low value is required for this measure.