Integrate with ADH cluster

In order to determine that a new cluster should be monitored, it is necessary to integrate it with the previously created monitoring cluster and to add a separate Monitoring service into it.

The steps for building integration between a monitoring cluster and ADH cluster are described below. All actions should be performed on the base of ADH cluster.

Step 1. Import monitoring settings

  1. Select a cluster on the Clusters page. To do this, click a cluster name in the Name column.

    Select a cluster
    Select a cluster
  2. Open the Import tab on the cluster page.

  3. Select Graphite and Grafana services of the previously created monitoring cluster.

  4. Click Import.

    Integration with a monitoring cluster
    Integration with a monitoring cluster

Step 2. Add a monitoring service

The steps for adding services to a cluster are listed below:

  1. Select a cluster on the Clusters page. To do this, click a cluster name in the Name column.

    Select a cluster
    Select a cluster
  2. Open the Services tab on the cluster page and click Add service.

    Switch to adding services
    Switch to adding services
  3. Select the service Monitoring in the opened dialog and click Add.

    Select services
    Select services
  4. As a result, the added services are displayed on the Services tab.

    The result of successful adding services to a cluster
    The result of successful adding services to a cluster

Step 3. Map monitoring components

The steps for adding components to hosts are listed below:

  1. Select a cluster on the Clusters page. To do this, click a cluster name in the Name column.

    Select a cluster
    Select a cluster
  2. Open the Mapping tab on the cluster page, map monitoring components to all cluster hosts, and click Save.

    Map components to hosts
    Map components to hosts

Step 4. Install a monitoring service

  1. Open the Services tab in the cluster menu. Click the actions default dark actions default light icon in the Actions column and select the Install action in the row that refers to the Monitoring service. Verify the action in the opened window.

    Switch to monitoring service installation
    Switch to monitoring service installation
  2. Wait until the job is completed. After successful installation, the monitoring service changes its state from created to installed .

    NOTE
    In case of errors, you can find logs on the Jobs page.
    Monitoring installation is completed
    Monitoring installation is completed
CAUTION
After you install the monitoring cluster, you need to restart the ADH cluster to view metrics.

Step 5. Verify results

To ensure that installation process is completed successfully, check the following:

  • System metrics are collected from the hosts of your cluster, not only from the host where the monitoring cluster has been deployed earlier.

  • Along with system metrics, service metrics are collected from the hosts of your cluster. For example, ADH cluster provides metrics for such services as HDFS, YARN, HBase, Spark.

You can check it both in the Graphite and Grafana web-interface.

Graphite

  1. In the browser bar, enter an address of the host where the monitoring cluster is deployed. To specify the port number, use the value of the Web-interface TCP port parameter from the ip_and_ports section defined when configuring the Graphite service during the monitoring cluster installation. The value 80 (used by default) can be omitted.

  2. Expand a tree at the left side of the opened form. System and service metrics are displayed there, grouped by hosts. You can select some of these metrics to view their change dynamics in the form of a graph at the right side of the screen.

    New hosts and service metrics are available in Graphite
    New hosts and service metrics are available in Graphite
    New hosts and service metrics are available in Graphite
    New hosts and service metrics are available in Graphite

Grafana

  1. In the browser bar, enter an address of the host where the monitoring cluster is deployed. To specify the port number, use the value of the Port parameter from the ip_and_ports section defined when configuring the Grafana service during the monitoring cluster installation (by default, 3000).

  2. Select the Home menu item in the opened form.

  3. Notice that new dashboards are available. Select one of them to view the service metrics that are collected from your cluster.

    Switch to service metrics
    Switch to service metrics
  4. View available graphs.

    View service metrics
    View service metrics
Found a mistake? Seleсt text and press Ctrl+Enter to report it