Add components

Eugenia Kuzina, Daria Barysheva

In ADCM, a component means a part of a service that should be deployed on one or several cluster hosts. For example, HDFS service can consist of such components as DataNode, NameNode, Client, and others.

IMPORTANT

Initially, there are no components on any of cluster hosts. You should map components to hosts manually.

The steps for adding components to hosts are listed below:

Select a cluster on the Clusters page. To do this, click a cluster name in the Name column.

Select a cluster
Open the Mapping tab on the cluster page.

Switch to mapping service components

In the window that opens, map components to hosts. To assign hosts for each component, click Add hosts and select hosts in the pop-up window.

Select hosts for a component

Mandatory components

Each service can have mandatory and optional components. Mandatory components are highlighted in red. The ADCM UI also displays how many mandatory components should be installed.

Mandatory components

CAUTION

Without assigning a necessary number of hosts to mandatory components, the component mapping cannot be saved.

The examples of distribution components in ADH clusters consisting of 3, 6, and 9 hosts are described in the table below. Examples are based on the Enterprise Edition of ADH.

Examples of components distribution

3 hosts
6 hosts
9 hosts

Host

Service

Component

Host 1

Core configuration

Configuration server

Flink

Flink Client

Flink JobManager

Flink TaskManager

Flink SQL-Gateway

Flink2

Flink2 Client

Flink2 SQL-Gateway

HBase

HBase Client

HBase RegionServer

HDFS

HDFS Client

HDFS DataNode

HDFS JournalNode

HDFS NameNode

HDFS ZKFC

Hive

Hive Client

Hive Metastore

Hive Tez

Impala

Impala Daemon

Impala Statestore

Impala Catalog Service

Kyuubi

Kyuubi Server

Monitoring

Grafana

Node Exporter

Ozone

Ozone Manager

Ozone Storage Container Manager

Ozone Recon

Ozone HttpFS

Ozone Datanode

Ozone Client

Solr

Solr Server

Spark3

Spark3 Client

Spark3 History Server

Spark4

Spark4 Client

Spark4 History Server

Trino

Trino Coordinator

Trino Client

YARN

MapReduce History Server

YARN Client

YARN NodeManager

Zookeeper

Zookeeper Server

Host 2

Airflow2

Airflow2 Broker

Airflow2 Flower

Airflow2 Scheduler

Airflow2 Server

Airflow2 Worker

Flink

Flink Client

Flink JobManager

Flink TaskManager

Flink History Server

Flink2

Flink2 Client

Flink2 History Server

HBase

HBase Client

HBase Master server

HBase Phoenix Query Server

HBase RegionServer

HBase Thrift1 Server

HDFS

HDFS Client

HDFS DataNode

HDFS HttpFS server

HDFS JournalNode

Hive

Hive Client

Hive HiveServer2

Hive Tez

Hive Tez UI

Impala

Impala Daemon

Kyuubi

Kyuubi Server

Monitoring

Prometheus Server

Node Exporter

Ozone

Ozone Manager

Ozone Storage Container Manager

Ozone Datanode

Ozone Client

Solr

Solr Server

Solr prometheus exporter

Spark3

Spark3 Client

Spark3 Livy Server

Spark4

Spark4 Client

Trino

Trino Worker

Trino Client

YARN

YARN Client

YARN NodeManager

YARN ResourceManager

Zeppelin

Zeppelin Server

Zookeeper

Zookeeper Server

Host 3

ADPG

Arenadata PostgreSQL

Flink

Flink JobManager

Flink TaskManager

Flink Client

Flink2

Flink2 Client

HBase

HBase Client

HBase RegionServer

HBase Thrift2 Server

HBase REST Server

HDFS

HDFS Client

HDFS DataNode

HDFS JournalNode

HDFS NameNode

HDFS ZKFC

Hive

Hive Client

Hive Tez

HUE

HUE Server

Impala

Impala Daemon

Impala Client

Kyuubi

Kyuubi Server

Monitoring

Node Exporter

Ozone

Ozone Manager

Ozone Storage Container Manager

Ozone S3G

Ozone Datanode

Ozone Client

Solr

Solr Server

Spark3

Spark3 Client

Spark3 Connect

Spark4

Spark4 Client

Spark4 Connect

SSM

SSM Server

SSM Agent

Trino

Trino Worker

Trino Client

YARN

YARN Client

YARN NodeManager

YARN Timeline Server

Zookeeper

Zookeeper Server

Host

Service

Component

Host 1

Airflow2

Airflow2 Worker

Core configuration

Configuration server

Flink

Flink JobManager

Flink TaskManager

Flink Client

Flink2

Flink2 Client

HDFS

HDFS JournalNode

HDFS NameNode

HDFS ZKFC

HDFS Client

Hive

Hive Metastore

Impala

Impala Statestore

Impala Catalog Service

Kyuubi

Kyuubi Server

Monitoring

Grafana

Node Exporter

Ozone

Ozone Manager

Ozone Storage Container Manager

Ozone Recon

Ozone Client

Solr

Solr Server

Spark3

Spark3 History Server

Spark4

Spark4 History Server

Trino

Trino Coordinator

YARN

MapReduce History Server

YARN Client

Zookeeper

Zookeeper Server

Host 2

Airflow2

Airflow2 Broker

Airflow2 Flower

Airflow2 Scheduler

Airflow2 Server

Airflow2 Worker

Flink

Flink History Server

Flink TaskManager

Flink JobManager

Flink Client

Flink2

Flink2 Client

Flink2 History Server

HBase

HBase Master server

HBase Phoenix Query Server

HDFS

HDFS JournalNode

HDFS HttpFS server

HDFS Client

Hive

Hive HiveServer2

Hive Tez UI

Monitoring

Prometheus Server

Node Exporter

Ozone

Ozone Manager

Ozone Storage Container Manager

Ozone S3G

Ozone Client

Solr

Solr Server

Solr prometheus exporter

Spark3

Spark3 Livy Server

YARN

YARN ResourceManager

YARN Client

Zeppelin

Zeppelin Server

Host 3

Airflow2

Airflow2 Worker

ADPG

Arenadata PostgreSQL

Flink

Flink JobManager

Flink TaskManager

Flink SQL-Gateway

Flink Client

Flink2

Flink2 Client

Flink2 SQL-Gateway

HBase

HBase Thrift2 Server

HBase REST Server

HDFS

HDFS NameNode

HDFS ZKFC

HDFS JournalNode

HDFS Client

HUE

HUE Server

Kyuubi

Kyuubi Server

Monitoring

Node Exporter

Ozone

Ozone Manager

Ozone Storage Container Manager

Ozone HttpFS

Ozone Client

Solr

Solr Server

Spark3

Spark3 Connect

Spark4

Spark4 Connect

SSM

SSM Server

SSM Agent

YARN

YARN Timeline Server

YARN Client

Zookeeper

Zookeeper Server

Host 4

Airflow2

Airflow2 Worker

Flink

Flink Client

Flink JobManager

Flink2

Flink2 Client

HDFS

HDFS DataNode

HDFS Client

HBase

HBase Client

HBase RegionServer

HBase Thrift1 Server

Hive

Hive Tez

Hive Client

Impala

Impala Daemon

Impala Client

Monitoring

Node Exporter

Ozone

Ozone Client

Ozone Datanode

Spark3

Spark3 Client

Spark4

Spark4 Client

Trino

Trino Worker

Trino Client

YARN

YARN NodeManager

YARN Client

Host 5

Airflow2

Airflow2 Worker

Flink

Flink JobManager

Flink Client

Flink2

Flink2 Client

HBase

HBase Client

HBase RegionServer

HDFS

HDFS DataNode

HDFS Client

Hive

Hive Tez

Hive Client

Impala

Impala Daemon

Impala Client

Kyuubi

Kyuubi Server

Monitoring

Node Exporter

Ozone

Ozone Client

Ozone Datanode

Spark3

Spark3 Client

Spark4

Spark4 Client

Trino

Trino Worker

Trino Client

YARN

YARN NodeManager

YARN Client

Zookeeper

Zookeeper Server

Host 6

Airflow2

Airflow2 Worker

Flink

Flink JobManager

Flink Client

Flink2

Flink2 Client

HBase

HBase Client

HBase RegionServer

HDFS

HDFS DataNode

HDFS Client

Hive

Hive Tez

Hive Client

Impala

Impala Daemon

Impala Client

Monitoring

Node Exporter

Ozone

Ozone Client

Ozone Datanode

Spark3

Spark3 Client

Spark4

Spark4 Client

Trino

Trino Worker

Trino Client

YARN

YARN NodeManager

YARN Client

Host

Service

Component

Host 1

Core configuration

Configuration server

Flink

Flink TaskManager

Flink SQL-Gateway

HDFS

HDFS JournalNode

HDFS NameNode

HDFS ZKFC

HDFS Client

Hive

Hive Metastore

Impala

Impala Statestore

Impala Catalog Service

Monitoring

Grafana

Node Exporter

Ozone

Ozone Manager

Ozone Storage Container Manager

Ozone Recon

Ozone HttpFS

Ozone Client

Solr

Solr Server

Spark3

Spark3 History Server

Trino

Trino Coordinator

YARN

YARN Client

MapReduce History Server

Host 2

Airflow2

Airflow2 Broker

Airflow2 Flower

Airflow2 Scheduler

Airflow2 Server

Airflow2 Worker

Flink

Flink TaskManager

HBase

HBase Master server

HBase Phoenix Query Server

HBase Thrift1 Server

HDFS

HDFS JournalNode

HDFS HttpFS server

HDFS Client

Hive

Hive HiveServer2

Hive Tez UI

Monitoring

Prometheus Server

Node Exporter

Ozone

Ozone Client

Spark3

Spark3 Livy Server

Trino

Trino Client

YARN

YARN Client

YARN ResourceManager

Zeppelin

Zeppelin Server

Host 3

Flink

Flink TaskManager

Flink History Server

Flink2

Flink2 SQL-Gateway

HBase

HBase Thrift2 Server

HBase REST Server

HDFS

HDFS NameNode

HDFS ZKFC

HDFS JournalNode

HDFS Client

Monitoring

Node Exporter

Ozone

Ozone Manager

Ozone Storage Container Manager

Ozone Client

Spark3

Spark3 Connect

Trino

Trino Client

YARN

YARN Client

YARN Timeline Server

Zeppelin

Zeppelin Server

Zookeeper

Zookeeper Server

Host 4

ADPG

Arenadata PostgreSQL

Flink2

Flink2 History Server

HDFS

HDFS JournalNode

HDFS NameNode

HDFS ZKFC

HDFS HttpFS server

HDFS Client

HBase

HBase Master server

HUE

HUE Server

Kyuubi

Kyuubi Server

Monitoring

Node Exporter

Ozone

Ozone Datanode

Ozone Client

Spark4

Spark4 History Server

SSM

SSM Server

SSM Agent

Trino

Trino Client

YARN

YARN Client

YARN NodeManager

Host 5

HDFS

HDFS JournalNode

HDFS NameNode

HDFS ZKFC

HDFS Client

HBase

HBase Master server

Monitoring

Node Exporter

Ozone

Ozone Manager

Ozone Storage Container Manager

Ozone S3G

Ozone Client

Solr

Solr Server

Solr prometheus exporter

Spark4

Spark4 Connect

Trino

Trino Worker

YARN

YARN Client

YARN NodeManager

Host 6

Flink

Flink Client

Flink JobManager

Flink2

Flink2 Client

HDFS

HDFS DataNode

HDFS Client

HBase

HBase Client

HBase RegionServer

Hive

Hive Tez

Hive Client

Impala

Impala Daemon

Impala Client

Monitoring

Node Exporter

Ozone

Ozone Client

Ozone Datanode

Spark3

Spark3 Client

Spark4

Spark4 Client

Trino

Trino Worker

YARN

YARN NodeManager

YARN Client

Zookeeper

Zookeeper Server

Host 7

Flink

Flink Client

Flink JobManager

Flink2

Flink2 Client

HDFS

HDFS DataNode

HDFS Client

HBase

HBase Client

HBase RegionServer

Hive

Hive Tez

Hive Client

Impala

Impala Daemon

Impala Client

Kyuubi

Kyuubi Server

Monitoring

Node Exporter

Ozone

Ozone Client

Ozone Datanode

Spark3

Spark3 Client

Spark4

Spark4 Client

Trino

Trino Worker

YARN

YARN NodeManager

YARN Client

Host 8

Flink

Flink Client

Flink JobManager

Flink2

Flink2 Client

HDFS

HDFS DataNode

HDFS Client

HBase

HBase Client

HBase RegionServer

Hive

Hive Tez

Hive Client

Impala

Impala Daemon

Impala Client

Monitoring

Node Exporter

Ozone

Ozone Client

Ozone Datanode

Spark3

Spark3 Client

Spark4

Spark4 Client

Trino

Trino Worker

YARN

YARN NodeManager

YARN Client

Host 9

Flink

Flink Client

Flink JobManager

Flink2

Flink2 Client

HDFS

HDFS DataNode

HDFS Client

HBase

HBase Client

HBase RegionServer

Hive

Hive Tez

Hive Client

Impala

Impala Daemon

Impala Client

Kyuubi

Kyuubi Server

Monitoring

Node Exporter

Ozone

Ozone Client

Ozone Datanode

Solr

Solr Server

Spark3

Spark3 Client

Spark4

Spark4 Client

Trino

Trino Worker

YARN

YARN NodeManager

YARN Client

Zookeeper

Zookeeper Server

After component distribution is completed, click Save.

Save mapping of components

Starting with ADCM 2.2.0, you can use another mapping mode — by hosts. To do this, switch on the Hosts mode toggle and map components to hosts by clicking Add components for each host sequentially.

Use mapping by hosts

Found a mistake? Seleсt text and press Ctrl+Enter to report it