Add components

In ADCM a component means a part of a service that should be deployed on one or several cluster hosts. For example, HDFS service can consist of such components as DataNode, NameNode, Client, and others.

IMPORTANT
Initially, there are no components on any of cluster hosts. You should map components to hosts manually.

The steps for adding components to hosts are listed below:

  1. Select a cluster on the Clusters page. To do this, click a cluster name in the Name column.

    Select a cluster
    Select a cluster
  2. Open the Mapping tab on the cluster page.

    Switch to mapping service components
    Switch to mapping service components
  3. In the window that opens, map components to hosts. To assign hosts for each component, click Add hosts and select hosts in the pop-up window.

    Select hosts for a component
    Select hosts for a component
    Mandatory components

     
    Each service can have mandatory and optional components. Mandatory components are highlighted in red. The ADCM UI also displays how many mandatory components should be installed.

    Mandatory components
    Mandatory components
    CAUTION
    Without assigning a necessary number of hosts to mandatory components, the component mapping cannot be saved.

    The examples of distribution components in ADH clusters consisting of 3, 6, and 9 hosts are described in the table below. Examples are based on the Enterprise Edition of ADH.

    Examples of components distribution
    • 3 hosts

    • 6 hosts

    • 9 hosts

    Host Service Component

    Host 1

    Flink

    Flink Client

    Flink JobManager

    Flink TaskManager

    Flink SQL-Gateway

    HBase

    HBase Client

    HBase RegionServer

    HDFS

    HDFS Client

    HDFS DataNode

    HDFS JournalNode

    HDFS NameNode

    HDFS ZKFC

    Hive

    Hive Client

    Hive Metastore

    Hive Tez

    Impala

    Impala Daemon

    Impala Statestore

    Impala Catalog Service

    Monitoring

    Monitoring Diamond

    Solr

    Solr Server

    Spark

    Spark Client

    Spark History server

    Spark3

    Spark3 Client

    Sqoop

    Sqoop Client

    YARN

    MapReduce History server

    YARN Client

    YARN NodeManager

    Zookeeper

    Zookeeper Server

    Host 2

    Airflow

    Airflow Metastore

    Airflow Server

    Airflow broker

    Flink

    Flink Client

    HBase

    HBase Client

    HBase Master server

    HBase Phoenix query server

    HBase RegionServer

    HDFS

    HDFS Client

    HDFS DataNode

    HDFS HttpFS server

    HDFS JournalNode

    Hive

    Hive Client

    Hive HiveServer2

    Hive Tez

    Hive TezUI

    Impala

    Impala Daemon

    Monitoring

    Monitoring Diamond

    Solr

    Solr Server

    Spark

    Spark Client

    Spark Livy server

    Spark3

    Spark3 Client

    Sqoop

    Sqoop Client

    Sqoop Metastore

    YARN

    YARN Client

    YARN NodeManager

    YARN ResourceManager

    Zeppelin

    Zeppelin Server

    Zookeeper

    Zookeeper Server

    Host 3

    Arenadata PostgreSQL

    Arenadata PostgreSQL

    Flink

    Flink Client

    HBase

    HBase Client

    HBase RegionServer

    HBase Thrift2 server

    HDFS

    HDFS Client

    HDFS DataNode

    HDFS JournalNode

    HDFS NameNode

    HDFS ZKFC

    Hive

    Hive Client

    Hive Tez

    Impala

    Impala Daemon

    Impala Client

    Kyuubi

    Kyuubi Server

    Monitoring

    Monitoring Diamond

    Monitoring jmxtrans

    MariaDB

    MariaDB Master server

    Solr

    Solr Server

    Spark

    Spark Client

    Spark Thrift server

    Spark3

    Spark3 Client

    Sqoop

    Sqoop Client

    SSM

    SSM Server

    SSM Agent

    YARN

    YARN Client

    YARN NodeManager

    YARN Timeline server

    Zookeeper

    Zookeeper Server

    Host Service Component

    Host 1

    Flink

    Flink JobManager

    Flink TaskManager

    Flink SQL-Gateway

    HDFS

    HDFS JournalNode

    HDFS NameNode

    HDFS ZKFC

    Hive

    Hive Metastore

    Impala

    Impala Statestore

    Impala Catalog Service

    Monitoring

    Monitoring Diamond

    Solr

    Solr Server

    Spark

    Spark History server

    YARN

    MapReduce History server

    Zookeeper

    Zookeeper Server

    Host 2

    Airflow

    Airflow Server

    Airflow Metastore

    Airflow broker

    HBase

    HBase Master server

    HBase Phoenix query server

    HDFS

    HDFS JournalNode

    HDFS HttpFS server

    Hive

    Hive HiveServer2

    Hive TezUI

    Monitoring

    Monitoring Diamond

    Solr

    Solr Server

    Spark

    Spark Livy server

    Sqoop

    Sqoop Metastore

    YARN

    YARN ResourceManager

    Zeppelin

    Zeppelin Server

    Zookeeper

    Zookeeper Server

    Host 3

    Arenadata PostgreSQL

    Arenadata PostgreSQL

    HBase

    HBase Thrift2 server

    HDFS

    HDFS NameNode

    HDFS ZKFC

    HDFS JournalNode

    Kyuubi

    Kyuubi Server

    Monitoring

    Monitoring Diamond

    Monitoring jmxtrans

    MariaDB

    MariaDB Master server

    Solr

    Solr Server

    Spark

    Spark Thrift server

    SSM

    SSM Server

    SSM Agent

    YARN

    YARN Timeline server

    Zookeeper

    Zookeeper Server

    Host 4

    Flink

    Flink Client

    HDFS

    HDFS DataNode

    HDFS Client

    HBase

    HBase Client

    HBase RegionServer

    Hive

    Hive Tez

    Hive Client

    Impala

    Impala Daemon

    Impala Client

    Monitoring

    Monitoring Diamond

    Spark

    Spark Client

    Spark3

    Spark3 Client

    Sqoop

    Sqoop Client

    YARN

    YARN NodeManager

    YARN Client

    Host 5

    Flink

    Flink Client

    HBase

    HBase Client

    HBase RegionServer

    HDFS

    HDFS DataNode

    HDFS Client

    Hive

    Hive Tez

    Hive Client

    Impala

    Impala Daemon

    Monitoring

    Monitoring Diamond

    Spark

    Spark Client

    Spark3

    Spark3 Client

    Sqoop

    Sqoop Client

    YARN

    YARN NodeManager

    YARN Client

    Host 6

    Flink

    Flink Client

    HBase

    HBase Client

    HBase RegionServer

    HDFS

    HDFS DataNode

    HDFS Client

    Hive

    Hive Tez

    Hive Client

    Impala

    Impala Daemon

    Monitoring

    Monitoring Diamond

    Spark

    Spark Client

    Spark3

    Spark3 Client

    Sqoop

    Sqoop Client

    YARN

    YARN NodeManager

    YARN Client

    Host Service Component

    Host 1

    Flink

    Flink JobManager

    Flink TaskManager

    Flink SQL-Gateway

    HDFS

    HDFS JournalNode

    HDFS NameNode

    HDFS ZKFC

    Hive

    Hive Metastore

    Impala

    Impala Statestore

    Impala Catalog Service

    Monitoring

    Monitoring Diamond

    Solr

    Solr Server

    Spark

    Spark History server

    YARN

    MapReduce History server

    Zookeeper

    Zookeeper Server

    Host 2

    Airflow

    Airflow Server

    Airflow Metastore

    Airflow broker

    Flink

    Flink TaskManager

    HBase

    HBase Master server

    HBase Phoenix query server

    HDFS

    HDFS JournalNode

    HDFS HttpFS server

    Hive

    Hive HiveServer2

    Hive TezUI

    Monitoring

    Monitoring Diamond

    Solr

    Solr Server

    Spark

    Spark Livy server

    Sqoop

    Sqoop Metastore

    YARN

    YARN ResourceManager

    Zeppelin

    Zeppelin Server

    Zookeeper

    Zookeeper Server

    Host 3

    HBase

    HBase Thrift2 server

    HDFS

    HDFS NameNode

    HDFS ZKFC

    HDFS JournalNode

    Monitoring

    Monitoring Diamond

    Monitoring jmxtrans

    MariaDB

    MariaDB Master server

    Solr

    Solr Server

    Spark

    Spark Thrift server

    YARN

    YARN Timeline server

    Zeppelin

    Zeppelin Server

    Zookeeper

    Zookeeper Server

    Host 4

    Arenadata PostgreSQL

    Arenadata PostgreSQL

    HDFS

    HDFS JournalNode

    HDFS NameNode

    HDFS ZKFC

    HDFS HttpFS server

    HBase

    HBase Master server

    Kyuubi

    Kyuubi Server

    Solr

    Solr Server

    SSM

    SSM Server

    SSM Agent

    Zookeeper

    Zookeeper Server

    Host 5

    HDFS

    HDFS JournalNode

    HDFS NameNode

    HDFS ZKFC

    HBase

    HBase Master server

    Solr

    Solr Server

    Zookeeper

    Zookeeper Server

    Host 6

    Flink

    Flink Client

    HDFS

    HDFS DataNode

    HDFS Client

    HBase

    HBase Client

    HBase RegionServer

    Hive

    Hive Tez

    Hive Client

    Impala

    Impala Daemon

    Impala Client

    Monitoring

    Monitoring Diamond

    Solr

    Solr Server

    Spark

    Spark Client

    Sqoop

    Sqoop Client

    YARN

    YARN NodeManager

    YARN Client

    Host 7

    Flink

    Flink Client

    HDFS

    HDFS DataNode

    HDFS Client

    HBase

    HBase Client

    HBase RegionServer

    Hive

    Hive Tez

    Hive Client

    Impala

    Impala Daemon

    Monitoring

    Monitoring Diamond

    Solr

    Solr Server

    Spark

    Spark Client

    Sqoop

    Sqoop Client

    YARN

    YARN NodeManager

    YARN Client

    Host 8

    Flink

    Flink Client

    HDFS

    HDFS DataNode

    HDFS Client

    HBase

    HBase Client

    HBase RegionServer

    Hive

    Hive Tez

    Hive Client

    Impala

    Impala Daemon

    Monitoring

    Monitoring Diamond

    Spark

    Spark Client

    Sqoop

    Sqoop Client

    YARN

    YARN NodeManager

    YARN Client

    Host 9

    Flink

    Flink Client

    HDFS

    HDFS DataNode

    HDFS Client

    HBase

    HBase Client

    HBase RegionServer

    Hive

    Hive Tez

    Hive Client

    Impala

    Impala Daemon

    Monitoring

    Monitoring Diamond

    Spark

    Spark Client

    Sqoop

    Sqoop Client

    YARN

    YARN NodeManager

    YARN Client

  4. After component distribution is completed, click Save.

    Save mapping of components
    Save mapping of components
  5. To open an alternative mapping view (by hosts), select the Hosts view tab.

    View mapping by hosts
    View mapping by hosts
Found a mistake? Seleсt text and press Ctrl+Enter to report it