Integrate with ADS cluster

In order to determine that a new cluster should be monitored, it is necessary to add a separate service Monitoring clients and integrate it with the previously created ET cluster. The steps for building integration between an ET cluster and ADS cluster are described below. All actions should be performed on the base of ADS cluster.

Step 1. Add a monitoring service

The steps for adding services to a cluster are listed below:

  1. Select a cluster on the Clusters page. To do this, click a cluster name in the Name column.

    Select a cluster
    Select a cluster
  2. Open the Services tab on the cluster page and click Add service.

    Switch to adding services
    Switch to adding services
  3. Select the service Monitoring Clients in the opened dialog and click Add.

    Select services
    Select services
  4. As a result, the successfully added service is displayed on the Services tab.

The result of successfully adding a service to the cluster
The result of successfully adding a service to the cluster

Step 2. Map monitoring components

The steps for adding components to hosts are listed below:

  1. Select a cluster on the Clusters page. To do this, click a cluster name in the Name column.

    Select a cluster
    Select a cluster
  2. Open the Mapping tab on the cluster page, add monitoring components to the cluster hosts and click Save.

    Map components to hosts
    Map components to hosts
IMPORTANT
  • Add the System Metric Agent on all hosts.

  • JMX metric Collector can only be added to one host.

Step 3. Import monitoring settings

  1. Select a cluster on the Clusters page. To do this, click a cluster name in the Name column.

    Select a cluster
    Select a cluster
  2. Open the Import tab on the cluster page and go to the Services tab.

    Switch to setting up import of services
    Switch to setting up import of services
  3. In the Import to drop-down list, select the Monitoring Clients service.

  4. Select the Graphite and Grafana services of the previously created monitoring cluster.

  5. Click Import.

    Integrate with a ET cluster
    Integrate with a ET cluster

Step 4. Install a monitoring service

  1. Open the Services tab in the cluster menu. Click the actions default dark actions default light icon in the Actions column and select the Install action in the row that refers to the Monitoring Clients.

    Switch to installing the monitoring service
    Switch to installing the monitoring service
  2. In the dialog box that opens, select required installation parameters and click Run.

  3. Verify the action in the opened window.

    Action confirmation
    Verify the action
  4. Wait until the job is completed. After successful installation, the monitoring service changes its state from created to installed .

    NOTE
    In case of errors, you can find logs on the Jobs page.
    Monitoring installation is completed
    Monitoring installation is completed

Step 5. Verify results

To ensure that installation process is completed successfully, check the following:

  • System metrics are collected from the hosts of your cluster, not only from the host where the monitoring cluster has been deployed earlier.

  • Along with system metrics, service metrics are collected from the hosts of your cluster. For example, ADS cluster provides metrics for such services as Kafka, Nifi, Minifi.

You can check it both in the Graphite and Grafana web-interface.

Graphite

  1. In the browser bar, enter an address of the host where the monitoring cluster is deployed. To specify the port number, use the value of the Web-interface TCP port parameter from the ip_and_ports section defined when configuring the Graphite service during the monitoring cluster installation. The value 80 (used by default) can be omitted.

  2. Expand a tree at the left side of the opened form. System and service metrics are displayed there, grouped by hosts. You can select some of these metrics to view their change dynamics in the form of a graph at the right side of the screen.

    New hosts and service metrics are available in Graphite
    New hosts and service metrics are available in Graphite
    New hosts and service metrics are available in Graphite
    New hosts and service metrics are available in Graphite

Grafana

  1. In the browser bar, enter an address of the host where the monitoring cluster is deployed. To specify the port number, use the value of the Port parameter from the ip_and_ports section defined when configuring the Grafana service during the monitoring cluster installation (by default, 3000).

  2. Select the Home menu item in the opened form.

  3. Notice that new dashboards are available. Select one of them to view the service metrics that are collected from your cluster.

    Switch to service metrics
    Switch to service metrics
  4. View available graphs.

    View service metrics
    View service metrics
Found a mistake? Seleсt text and press Ctrl+Enter to report it