Integration with ADS cluster

In order to determine that a new cluster should be monitored, it is necessary to add a separate service Monitoring clients and integrate it with the previously created monitoring cluster.

The steps for building integration between a monitoring cluster and ADS cluster are described below. All actions should be performed on the base of ADS cluster.

Step 1. Adding a monitoring service

The steps for adding services to a cluster are listed below:

  1. From the CLUSTERS tab switch to the cluster configuring. To do this, click the row that contains the added cluster or click the icon in the Config column. Both methods open the cluster menu.

    adcm cluster config
    Switching to cluster configuring
  2. Open the Services tab in the cluster menu and click Add services.

    mon import 02
    Switching to services adding
  3. Select the service Monitoring Clients in the opened dialog and click Add.

    mon import 03
    Choosing services
  4. As a result, the added services are displayed at the Services tab.

    mon import 04
    The result of successful adding services to a cluster

Step 2. Distribution of monitoring components

The steps of adding components to hosts are listed below:

  1. From the CLUSTERS tab switch to the cluster configuring. To do this, click the row that contains the added cluster or click the icon in the Config column. Both methods open the cluster menu.

    adcm cluster config
    Switching to cluster configuring
  2. Open the Hosts - Components tab in the cluster menu, add monitoring components to the cluster hosts and click Save.

    mon import 05
    Distribution of components between hosts
IMPORTANT
  • Add the System Metric Agent on all hosts.

  • JMX metric Collector can only be added to one host.

Step 3. Importing monitoring settings

  1. From the CLUSTERS tab switch to the cluster configuring. To do this, click the row that contains the added cluster or click the icon in the Config column. Both methods open the cluster menu.

    adcm cluster config
    Switching to cluster configuring
  2. Open the Services tab in the cluster menu.

  3. Select the service Monitoring Clients and switch to the service configuring.

    mon import 02
    Switching to the service configuring
  4. Open the Import tab in the service Monitoring Сlients menu.

  5. Select two components in the Graphite and Grafana panes. These components correspond to the related services of the previously created monitoring cluster.

  6. Click Save.

    mon import 01
    Integrating with the monitoring cluster

Step 4. Installing a monitoring service

  1. Open the Services tab in the cluster menu. Click the icon in the Actions column and choose the Install action in the row that refers to the Monitoring Clients service. Verify the action in the opened window.

    mon import 07
    Switching to installing a monitoring service
  2. Wait until the installing process is completed. After the successful installation the monitoring service changes its state from created to installed .

    NOTE
    In case of errors, you can find the logs at the JOBS tab.
    mon import 08
    The installing process is completed

Step 5. Verifying the results

To ensure that installation process is completed successfully, check the following:

  • System metrics are collected from the hosts of your cluster, not only from the host where the monitoring cluster has been deployed earlier.

  • Along with system metrics, service metrics are collected from the hosts of your cluster. For example, ADS cluster provides metrics for such services as Kafka, Nifi, Minifi.

You can check it both in the Graphite and Grafana web-interface.

Graphite

  1. Enter in the browser bar the address of the host where the monitoring cluster is deployed. To specify the port number, use the value of the Web-interface TCP port parameter from the ip_and_ports section defined when configuring the Graphite service during the monitoring cluster installation. The value 80 (used by default) can be omitted.

  2. Expand a tree at the left side of the opened form. System and service metrics are displayed there, grouped by hosts. You can select some of these metrics to view their change dynamics in the form of a graph at the right side of the screen.

    mon import 09 dark
    New hosts and service metrics are available in Graphite
    mon import 09 light
    New hosts and service metrics are available in Graphite

Grafana

  1. Enter in the browser bar the address of the host where the monitoring cluster is deployed. To specify the port number, use the value of the Port parameter from the ip_and_ports section defined when configuring the Grafana service during the monitoring cluster installation (by default 3000).

  2. Select the Home menu item in the opened form.

  3. Notice that new dashboards are available. Select one of them to view the service metrics that are collected from your cluster.

    mon import 10
    Switching to service metrics
  4. View available graphs.

    mon import 11
    Viewing service metrics
Found a mistake? Seleсt text and press Ctrl+Enter to report it