eG Monitoring
 

Measures reported by StormOwnResTest

This test monitors the resources utilized by the users (owners) that includes total number of topologies, executors, workers and tasks completed by the owners in the target Apache Storm. Using this test, administrators would be able to identify the number of used CPU cores, the total memory used by the CPU and the heap/off-heap memory assigned to the owners. Any abnormal condition in the resource usage will alert the administrators to take preventive action against the abnormality.

Outputs of the test: One set of results for each owner (user) in the target Apache Storm.

Descriptor: Owner (user)

The measures made by this test are as follows:

Measurement Description Measurement Unit Interpretation
totalTopologies Indicates the total number of topologies used by this owner. Number

 
totalExecutors Indicates the total number of executors used by this owner. Number

 
totalWorkers Indicates the total number of worker nodes used by this owner. Number

 
totalTasks Indicates the total number of tasks completed by this owner. Number

A very high value is required for this measure.
totalReqMem Indicates the total size of memory requested by this owner. MB

 
totalMemoryUsage Indicates the total size of memory used by this owner. MB

A very low value is required for this measure.
totalReqCpu Indicates the total number of CPU cores requested by this owner. Number

 
totalCpuUsage Indicates the total number of CPU cores used by this owner. Number

A very low value is required for this measure.
memoryGuarantee Indicates the size of memory guaranteed for this owner. MB

 
memoryGuaranteeRemaining Indicates the size of memory remain guaranteed for this owner. MB

 
cpuGuarantee Indicates the number of CPU cores guaranteed for this owner. Number

Reservation specifies the guaranteed reservation for CPU cores. The Apache Storm server will execute a comfortable data processing only if the CPU and memory reservation is available.
cpuGuaranteeRemaining Indicates the number of CPU cores remain guaranteed for this owner. Number

 
isolatedNodes Indicates the number of isolated nodes for this owner. Number

 
totalReqOnHeapMem Indicates the total size of heap memory requested by this owner. MB

 
totalAssignedOnHeapMem Indicates the total size of heap memory assigned to this owner. MB

As a rule of thumb, there should be enough heap memory to address data processing. If the heap memory is high, then it leads to garbage collection.
totalReqOffHeapMem Indicates the total size of off-heap memory requested by this owner. MB

 
totalAssignedOffHeapMem Indicates the total size of off-heap memory assigned to this owner. MB

If there is no off-heap memory, then you will be unable to perform the data processing. To avoid this, it would be good practice to allocate adequate off-heap memory.