All
ADH
ADPG
ADBSC
ADB
ADS
ADQM
ADCM
Showing 5 of 16 results. See all results...

Adding components

In ADCM a component means a part of a service that should be deployed on one or several cluster hosts. For example, HDFS service can consist of such components as DataNode, NameNode, Client, and others.

IMPORTANT
Initially, there are no components on any of cluster hosts — the distribution of components between hosts should be performed manually.

The steps of adding components to hosts are listed below:

  1. From the CLUSTERS tab switch to the cluster configuring. To do this, click the row that contains the added cluster or click the icon in the Config column. Both methods open the cluster menu.

    adcm cluster config
    Switching to cluster configuring

  2. Open the Hosts - Components tab in the cluster menu.

    NOTE
    The orange exclamation mark near the Hosts - Components menu item is displayed when the components distribution is needed.
    adcm components 01
    Switching to services components distribution

  3. In the opened window, distribute all necessary components between cluster hosts. To distribute components, use one of the ways:

    • Select a component in the Components column (by clicking at it) and then define all hosts for it in the Hosts column (by alternate clicking at each host).

      adcm components 02
      Choosing hosts for a component

    • Select a host in the Hosts column (by clicking at it) and define all components for it in the Components column (by alternate clicking at each component).

      adcm components 03
      Choosing components for a host
    Mandatory and optional components

     
    Each service can have mandatory and optional components:

    • If the component is optional, it has a simple quantitative counter located to the right of its name — without the / symbol. This counter displays the number of hosts that is assigned to the current component.

      adcm components 04
      Optional components

    • If the component is mandatory, its quantitative counter contains the / symbol. The first digit in the counter (displayed before /) shows the current number of assigned hosts, and the second digit (displayed after /) — the minimal required number of hosts.

      adcm components 05
      Mandatory components
      CAUTION
      Without assigning necessary count of hosts to mandatory components, the service distribution map cannot be saved.

    The examples of distribution components in ADH clusters consisting of 3, 6, and 9 hosts are described in the table below. Examples are based on the Enterprise Edition of ADH.

    Examples of components distribution

    • 3 hosts

    • 6 hosts

    • 9 hosts

    Host Service Component

    Host 1

    Flink

    Flink Client

    Flink JobManager

    Flink TaskManager

    HBase

    HBase Client

    HBase RegionServer

    HDFS

    HDFS Client

    HDFS DataNode

    HDFS JournalNode

    HDFS NameNode

    HDFS ZKFC

    Hive

    Hive Client

    Hive Metastore

    Hive Tez

    Monitoring

    Monitoring Diamond

    Solr

    Solr Server

    Spark

    Spark Client

    Spark History server

    Spark3

    Spark3 Client

    Sqoop

    Sqoop Client

    YARN

    MapReduce History server

    YARN Client

    YARN NodeManager

    Zookeeper

    Zookeeper Server

    Host 2

    Airflow

    Airflow Metastore

    Airflow Server

    Airflow broker

    Flink

    Flink Client

    HBase

    HBase Client

    HBase Master server

    HBase Phoenix query server

    HBase RegionServer

    HDFS

    HDFS Client

    HDFS DataNode

    HDFS HttpFS server

    HDFS JournalNode

    Hive

    Hive Client

    Hive HiveServer2

    Hive Tez

    Hive TezUI

    Monitoring

    Monitoring Diamond

    Solr

    Solr Server

    Spark

    Spark Client

    Spark Livy server

    Spark3

    Spark3 Client

    Sqoop

    Sqoop Client

    Sqoop Metastore

    YARN

    YARN Client

    YARN NodeManager

    YARN ResourceManager

    Zeppelin

    Zeppelin Server

    Zookeeper

    Zookeeper Server

    Host 3

    Flink

    Flink Client

    HBase

    HBase Client

    HBase RegionServer

    HBase Thrift2 server

    HDFS

    HDFS Client

    HDFS DataNode

    HDFS JournalNode

    HDFS NameNode

    HDFS ZKFC

    Hive

    Hive Client

    Hive Tez

    Monitoring

    Monitoring Diamond

    Monitoring jmxtrans

    MySQL

    MySQL Master server

    Solr

    Solr Server

    Spark

    Spark Client

    Spark Thrift server

    Spark3

    Spark3 Client

    Sqoop

    Sqoop Client

    YARN

    YARN Client

    YARN NodeManager

    YARN Timeline server

    Zookeeper

    Zookeeper Server
    Host Service Component

    Host 1

    Flink

    Flink JobManager

    Flink TaskManager

    HDFS

    HDFS JournalNode

    HDFS NameNode

    HDFS ZKFC

    Hive

    Hive Metastore

    Monitoring

    Monitoring Diamond

    Solr

    Solr Server

    Spark

    Spark History server

    YARN

    MapReduce History server

    Zookeeper

    Zookeeper Server

    Host 2

    Airflow

    Airflow Server

    Airflow Metastore

    Airflow broker

    HBase

    HBase Master server

    HBase Phoenix query server

    HDFS

    HDFS JournalNode

    HDFS HttpFS server

    Hive

    Hive HiveServer2

    Hive TezUI

    Monitoring

    Monitoring Diamond

    Solr

    Solr Server

    Spark

    Spark Livy server

    Sqoop

    Sqoop Metastore

    YARN

    YARN ResourceManager

    Zeppelin

    Zeppelin Server

    Zookeeper

    Zookeeper Server

    Host 3

    HBase

    HBase Thrift2 server

    HDFS

    HDFS NameNode

    HDFS ZKFC

    HDFS JournalNode

    Monitoring

    Monitoring Diamond

    Monitoring jmxtrans

    MySQL

    MySQL Master server

    Solr

    Solr Server

    Spark

    Spark Thrift server

    YARN

    YARN Timeline server

    Zookeeper

    Zookeeper Server

    Host 4

    Flink

    Flink Client

    HDFS

    HDFS DataNode

    HDFS Client

    HBase

    HBase Client

    HBase RegionServer

    Hive

    Hive Tez

    Hive Client

    Monitoring

    Monitoring Diamond

    Spark

    Spark Client

    Spark3

    Spark3 Client

    Sqoop

    Sqoop Client

    YARN

    YARN NodeManager

    YARN Client

    Host 5

    Flink

    Flink Client

    HBase

    HBase Client

    HBase RegionServer

    HDFS

    HDFS DataNode

    HDFS Client

    Hive

    Hive Tez

    Hive Client

    Monitoring

    Monitoring Diamond

    Spark

    Spark Client

    Spark3

    Spark3 Client

    Sqoop

    Sqoop Client

    YARN

    YARN NodeManager

    YARN Client

    Host 6

    Flink

    Flink Client

    HBase

    HBase Client

    HBase RegionServer

    HDFS

    HDFS DataNode

    HDFS Client

    Hive

    Hive Tez

    Hive Client

    Monitoring

    Monitoring Diamond

    Spark

    Spark Client

    Spark3

    Spark3 Client

    Sqoop

    Sqoop Client

    YARN

    YARN NodeManager

    YARN Client
    Host Service Component

    Host 1

    Flink

    Flink JobManager

    Flink TaskManager

    HDFS

    HDFS JournalNode

    HDFS NameNode

    HDFS ZKFC

    Hive

    Hive Metastore

    Monitoring

    Monitoring Diamond

    Solr

    Solr Server

    Spark

    Spark History server

    YARN

    MapReduce History server

    Zookeeper

    Zookeeper Server

    Host 2

    Airflow

    Airflow Server

    Airflow Metastore

    Airflow broker

    Flink

    Flink TaskManager

    HBase

    HBase Master server

    HBase Phoenix query server

    HDFS

    HDFS JournalNode

    HDFS HttpFS server

    Hive

    Hive HiveServer2

    Hive TezUI

    Monitoring

    Monitoring Diamond

    Solr

    Solr Server

    Spark

    Spark Livy server

    Sqoop

    Sqoop Metastore

    YARN

    YARN ResourceManager

    Zeppelin

    Zeppelin Server

    Zookeeper

    Zookeeper Server

    Host 3

    HBase

    HBase Thrift2 server

    HDFS

    HDFS NameNode

    HDFS ZKFC

    HDFS JournalNode

    Monitoring

    Monitoring Diamond

    Monitoring jmxtrans

    MySQL

    MySQL Master server

    Solr

    Solr Server

    Spark

    Spark Thrift server

    YARN

    YARN Timeline server

    Zeppelin

    Zeppelin Server

    Zookeeper

    Zookeeper Server

    Host 4

    HDFS

    HDFS JournalNode

    HDFS NameNode

    HDFS ZKFC

    HDFS HttpFS server

    HBase

    HBase Master server

    Solr

    Solr Server

    Zookeeper

    Zookeeper Server

    Host 5

    HDFS

    HDFS JournalNode

    HDFS NameNode

    HDFS ZKFC

    HBase

    HBase Master server

    Solr

    Solr Server

    Zookeeper

    Zookeeper Server

    Host 6

    Flink

    Flink Client

    HDFS

    HDFS DataNode

    HDFS Client

    HBase

    HBase Client

    HBase RegionServer

    Hive

    Hive Tez

    Hive Client

    Monitoring

    Monitoring Diamond

    Solr

    Solr Server

    Spark

    Spark Client

    Sqoop

    Sqoop Client

    YARN

    YARN NodeManager

    YARN Client

    Host 7

    Flink

    Flink Client

    HDFS

    HDFS DataNode

    HDFS Client

    HBase

    HBase Client

    HBase RegionServer

    Hive

    Hive Tez

    Hive Client

    Monitoring

    Monitoring Diamond

    Solr

    Solr Server

    Spark

    Spark Client

    Sqoop

    Sqoop Client

    YARN

    YARN NodeManager

    YARN Client

    Host 8

    Flink

    Flink Client

    HDFS

    HDFS DataNode

    HDFS Client

    HBase

    HBase Client

    HBase RegionServer

    Hive

    Hive Tez

    Hive Client

    Monitoring

    Monitoring Diamond

    Spark

    Spark Client

    Sqoop

    Sqoop Client

    YARN

    YARN NodeManager

    YARN Client

    Host 9

    Flink

    Flink Client

    HDFS

    HDFS DataNode

    HDFS Client

    HBase

    HBase Client

    HBase RegionServer

    Hive

    Hive Tez

    Hive Client

    Monitoring

    Monitoring Diamond

    Spark

    Spark Client

    Sqoop

    Sqoop Client

    YARN

    YARN NodeManager

    YARN Client

  4. After components distribution is completed, click Save.

    adcm components 06
    Saving components distribution

  5. As a result, the orange exclamation mark near the menu item Hosts - Components stops being displayed.

    adcm components 07
    The result of successful components distribution
Found a mistake? Seleсt text and press Ctrl+Enter to report it