Configuration of ZeppParaStatTest

Notes are fundamental elements of a Zeppelin notebook and each instance of Zeppelin has only one notebook which contains many notes. The note can be viewed as a paragraph container. Each note consists of one or more paragraphs of code, which you can use to define and run snippets of code in a flexible manner. Each paragraph consists of 2 sections: code section where you put your source code and result section where you can see the result of the code execution. A paragraph contains code to access services, run jobs, and display results. The user can run all the paragraphs contained in a note sequentially or individual paragraphs can be selected for execution. The status of each paragraph will be shown while executing as READY, FINISHED, ABORT, ERROR, PENDING, and RUNNING. By tracking these status codes, administrator can clearly understand what was exactly happened while executing the paragraphs and can take necessary actions with respect to the respective status. This is where ZeppParaStatTest helps administrators.

This test continuously tracks the status codes of each paragraph that are executed and reports the number of paragraphs grouped under each status. This test also monitors the total number of paragraphs that are executed on the target Apache Zeppelin. The detailed diagnosis of these measures provides the Paragraph ID, progress, start and finish date of paragraphs grouped under each status.

The default parameters associated with this test are:

• The TEST PERIOD list box helps the user to decide how often this test needs to be executed.

• In the HOST text box, specify the HOST for which this test is to be configured.

• In the PORT text box, specify the port at which the target Zeppelin server listens to. The default port is 8080.

• To collect metrics from an Apache zeppelin server, the eG agent monitoring the server should be configured to use JMX to connect to the JVM used by the server and pull out the metrics of interest. If JMX requires authentication only (but no security), then ensure that the USER NAME and PASSWORD parameters are configured with the credentials of a user with read-write access to JMX. To know how to create this user, refer to Monitoring Apache Zeppelin. Confirm the password by retyping it in the CONFIRM PASSWORD text box.

• By default, the SSL flag is set to No indicating that the SSL (Secured Socket Layer) is not used to connect to the target Apache Zeppelin. If not so, set the SSL flag to Yes.

• Specify the duration (in seconds) for which this test should wait for a response from the Apache Zeppelin server in the TIMEOUT text box. If there is no response from the server beyond the configured duration, the test will timeout. By default, this is set to 5 seconds.

• To make diagnosis more efficient and accurate, eG embeds an optional detailed diagnostic capability. With this capability, the eG agents can be configured to run detailed, more elaborate tests as and when specific problems are detected. To enable the detailed diagnosis capability of this test, by default, for a particular server, choose the On option against DETAILED DIAGNOSIS. To disable the capability, click on the Off option.

  The option to selectively enable/disable the detailed diagnosis capability will be available only if the following conditions are fulfilled:

  • The eG manager license should allow the detailed diagnosis capability.

  • Both the bad and normal frequencies configured for the detailed diagnosis measures should not be 0.

• If multiple components of the same component type are awaiting configuration, then an APPLY TO OTHER COMPONENTS button will appear in this page. Clicking on this button will allow you to apply the configuration to all/selected components of that type.

• Once the necessary values have been provided, clicking on the UPDATE button will register the changes made.

When changing the configuration for specific servers, a “*” beside the text box corresponding to the parameter signifies that these values have to be manually configured by the user. The parameter values that require to be configured will typically be prefixed with a “$” or contain a series of “*”. A value of “none” in the parameter value indicates that the corresponding parameter value can be changed if required.