Add components

Eugenia Kuzina, Daria Barysheva

In ADCM a component means a part of a service that should be deployed on one or several cluster hosts. For example, HDFS service can consist of such components as DataNode, NameNode, Client, and others.

IMPORTANT

Initially, there are no components on any of cluster hosts. You should map components to hosts manually.

The steps for adding components to hosts are listed below:

Select a cluster on the Clusters page. To do this, click a cluster name in the Name column.

Select a cluster
Open the Mapping tab on the cluster page.

Switch to mapping service components

In the window that opens, map components to hosts. To assign hosts for each component, click Add hosts and select hosts in the pop-up window.

Select hosts for a component

Mandatory components

Each service can have mandatory and optional components. Mandatory components are highlighted in red. The ADCM UI also displays how many mandatory components should be installed.

Mandatory components

CAUTION

Without assigning a necessary number of hosts to mandatory components, the component mapping cannot be saved.

The examples of distribution components in ADH clusters consisting of 3, 6, and 9 hosts are described in the table below. Examples are based on the Enterprise Edition of ADH.

Examples of components distribution

3 hosts
6 hosts
9 hosts

Host

Service

Component

Host 1

Flink

Flink Client

Flink JobManager

Flink TaskManager

Flink SQL-Gateway

HBase

HBase Client

HBase RegionServer

HDFS

HDFS Client

HDFS DataNode

HDFS JournalNode

HDFS NameNode

HDFS ZKFC

Hive

Hive Client

Hive Metastore

Hive Tez

Impala

Impala Daemon

Impala Statestore

Impala Catalog Service

Monitoring

Monitoring Diamond

Solr

Solr Server

Spark

Spark Client

Spark History server

Spark3

Spark3 Client

Sqoop

Sqoop Client

YARN

MapReduce History server

YARN Client

YARN NodeManager

Zookeeper

Zookeeper Server

Host 2

Airflow

Airflow Metastore

Airflow Server

Airflow broker

Flink

Flink Client

HBase

HBase Client

HBase Master server

HBase Phoenix query server

HBase RegionServer

HDFS

HDFS Client

HDFS DataNode

HDFS HttpFS server

HDFS JournalNode

Hive

Hive Client

Hive HiveServer2

Hive Tez

Hive TezUI

Impala

Impala Daemon

Monitoring

Monitoring Diamond

Solr

Solr Server

Spark

Spark Client

Spark Livy server

Spark3

Spark3 Client

Sqoop

Sqoop Client

Sqoop Metastore

YARN

YARN Client

YARN NodeManager

YARN ResourceManager

Zeppelin

Zeppelin Server

Zookeeper

Zookeeper Server

Host 3

Arenadata PostgreSQL

Flink

Flink Client

HBase

HBase Client

HBase RegionServer

HBase Thrift2 server

HDFS

HDFS Client

HDFS DataNode

HDFS JournalNode

HDFS NameNode

HDFS ZKFC

Hive

Hive Client

Hive Tez

HUE

HUE Server

Impala

Impala Daemon

Impala Client

Kyuubi

Kyuubi Server

Monitoring

Monitoring Diamond

Monitoring jmxtrans

MariaDB

MariaDB Master server

Solr

Solr Server

Spark

Spark Client

Spark Thrift server

Spark3

Spark3 Client

Sqoop

Sqoop Client

SSM

SSM Server

SSM Agent

YARN

YARN Client

YARN NodeManager

YARN Timeline server

Zookeeper

Zookeeper Server

Host

Service

Component

Host 1

Flink

Flink JobManager

Flink TaskManager

Flink SQL-Gateway

HDFS

HDFS JournalNode

HDFS NameNode

HDFS ZKFC

Hive

Hive Metastore

Impala

Impala Statestore

Impala Catalog Service

Monitoring

Monitoring Diamond

Solr

Solr Server

Spark

Spark History server

YARN

MapReduce History server

Zookeeper

Zookeeper Server

Host 2

Airflow

Airflow Server

Airflow Metastore

Airflow broker

HBase

HBase Master server

HBase Phoenix query server

HDFS

HDFS JournalNode

HDFS HttpFS server

Hive

Hive HiveServer2

Hive TezUI

Monitoring

Monitoring Diamond

Solr

Solr Server

Spark

Spark Livy server

Sqoop

Sqoop Metastore

YARN

YARN ResourceManager

Zeppelin

Zeppelin Server

Zookeeper

Zookeeper Server

Host 3

Arenadata PostgreSQL

HBase

HBase Thrift2 server

HDFS

HDFS NameNode

HDFS ZKFC

HDFS JournalNode

HUE

HUE Server

Kyuubi

Kyuubi Server

Monitoring

Monitoring Diamond

Monitoring jmxtrans

MariaDB

MariaDB Master server

Solr

Solr Server

Spark

Spark Thrift server

SSM

SSM Server

SSM Agent

YARN

YARN Timeline server

Zookeeper

Zookeeper Server

Host 4

Flink

Flink Client

HDFS

HDFS DataNode

HDFS Client

HBase

HBase Client

HBase RegionServer

Hive

Hive Tez

Hive Client

Impala

Impala Daemon

Impala Client

Monitoring

Monitoring Diamond

Spark

Spark Client

Spark3

Spark3 Client

Sqoop

Sqoop Client

YARN

YARN NodeManager

YARN Client

Host 5

Flink

Flink Client

HBase

HBase Client

HBase RegionServer

HDFS

HDFS DataNode

HDFS Client

Hive

Hive Tez

Hive Client

Impala

Impala Daemon

Monitoring

Monitoring Diamond

Spark

Spark Client

Spark3

Spark3 Client

Sqoop

Sqoop Client

YARN

YARN NodeManager

YARN Client

Host 6

Flink

Flink Client

HBase

HBase Client

HBase RegionServer

HDFS

HDFS DataNode

HDFS Client

Hive

Hive Tez

Hive Client

Impala

Impala Daemon

Monitoring

Monitoring Diamond

Spark

Spark Client

Spark3

Spark3 Client

Sqoop

Sqoop Client

YARN

YARN NodeManager

YARN Client

Host

Service

Component

Host 1

Flink

Flink JobManager

Flink TaskManager

Flink SQL-Gateway

HDFS

HDFS JournalNode

HDFS NameNode

HDFS ZKFC

Hive

Hive Metastore

Impala

Impala Statestore

Impala Catalog Service

Monitoring

Monitoring Diamond

Solr

Solr Server

Spark

Spark History server

YARN

MapReduce History server

Zookeeper

Zookeeper Server

Host 2

Airflow

Airflow Server

Airflow Metastore

Airflow broker

Flink

Flink TaskManager

HBase

HBase Master server

HBase Phoenix query server

HDFS

HDFS JournalNode

HDFS HttpFS server

Hive

Hive HiveServer2

Hive TezUI

Monitoring

Monitoring Diamond

Solr

Solr Server

Spark

Spark Livy server

Sqoop

Sqoop Metastore

YARN

YARN ResourceManager

Zeppelin

Zeppelin Server

Zookeeper

Zookeeper Server

Host 3

HBase

HBase Thrift2 server

HDFS

HDFS NameNode

HDFS ZKFC

HDFS JournalNode

Monitoring

Monitoring Diamond

Monitoring jmxtrans

MariaDB

MariaDB Master server

Solr

Solr Server

Spark

Spark Thrift server

YARN

YARN Timeline server

Zeppelin

Zeppelin Server

Zookeeper

Zookeeper Server

Host 4

Arenadata PostgreSQL

HDFS

HDFS JournalNode

HDFS NameNode

HDFS ZKFC

HDFS HttpFS server

HBase

HBase Master server

HUE

HUE Server

Kyuubi

Kyuubi Server

Solr

Solr Server

SSM

SSM Server

SSM Agent

Zookeeper

Zookeeper Server

Host 5

HDFS

HDFS JournalNode

HDFS NameNode

HDFS ZKFC

HBase

HBase Master server

Solr

Solr Server

Zookeeper

Zookeeper Server

Host 6

Flink

Flink Client

HDFS

HDFS DataNode

HDFS Client

HBase

HBase Client

HBase RegionServer

Hive

Hive Tez

Hive Client

Impala

Impala Daemon

Impala Client

Monitoring

Monitoring Diamond

Solr

Solr Server

Spark

Spark Client

Sqoop

Sqoop Client

YARN

YARN NodeManager

YARN Client

Host 7

Flink

Flink Client

HDFS

HDFS DataNode

HDFS Client

HBase

HBase Client

HBase RegionServer

Hive

Hive Tez

Hive Client

Impala

Impala Daemon

Monitoring

Monitoring Diamond

Solr

Solr Server

Spark

Spark Client

Sqoop

Sqoop Client

YARN

YARN NodeManager

YARN Client

Host 8

Flink

Flink Client

HDFS

HDFS DataNode

HDFS Client

HBase

HBase Client

HBase RegionServer

Hive

Hive Tez

Hive Client

Impala

Impala Daemon

Monitoring

Monitoring Diamond

Spark

Spark Client

Sqoop

Sqoop Client

YARN

YARN NodeManager

YARN Client

Host 9

Flink

Flink Client

HDFS

HDFS DataNode

HDFS Client

HBase

HBase Client

HBase RegionServer

Hive

Hive Tez

Hive Client

Impala

Impala Daemon

Monitoring

Monitoring Diamond

Spark

Spark Client

Sqoop

Sqoop Client

YARN

YARN NodeManager

YARN Client

After component distribution is completed, click Save.

Save mapping of components

Starting with ADCM 2.2.0, you can use another mapping mode — by hosts. To do this, switch on the Hosts mode toggle and map components to hosts by clicking Add components for each host sequentially.

Use mapping by hosts

Found a mistake? Seleсt text and press Ctrl+Enter to report it