Add components

Eugenia Kuzina, Daria Barysheva

In ADCM a component means a part of a service that should be deployed on one or several cluster hosts. For example, HDFS service can consist of such components as DataNode, NameNode, Client, and others.

IMPORTANT

Initially, there are no components on any of cluster hosts. You should map components to hosts manually.

The steps for adding components to hosts are listed below:

Select a cluster on the Clusters page. To do this, click a cluster name in the Name column.

Select a cluster
Open the Mapping tab on the cluster page.

Switch to mapping service components

In the window that opens, map components to hosts. To assign hosts for each component, click Add hosts and select hosts in the pop-up window.

Select hosts for a component

Mandatory components

Each service can have mandatory and optional components. Mandatory components are highlighted in red. The ADCM UI also displays how many mandatory components should be installed.

Mandatory components

CAUTION

Without assigning a necessary number of hosts to mandatory components, the component mapping cannot be saved.

The examples of distribution components in ADH clusters consisting of 3, 6, and 9 hosts are described in the table below. Examples are based on the Enterprise Edition of ADH.

Examples of components distribution

3 hosts
6 hosts
9 hosts

Host

Service

Component

Host 1

Core configuration

Configuration server

Flink

Flink Client

Flink JobManager

Flink TaskManager

Flink SQL-Gateway

HBase

HBase Client

HBase RegionServer

HDFS

HDFS Client

HDFS DataNode

HDFS JournalNode

HDFS NameNode

HDFS ZKFC

Hive

Hive Client

Hive Metastore

Hive Tez

Impala

Impala Daemon

Impala Statestore

Impala Catalog Service

Monitoring

Grafana

Node Exporter

Ozone

Ozone Manager

Ozone Storage Container Manager

Ozone Recon

Ozone HttpFS

Ozone Datanode

Solr

Solr Server

Spark3

Spark3 Client

Spark3 History server

Trino

Trino Coordinator

Trino Client

YARN

MapReduce History server

YARN Client

YARN NodeManager

ZooKeeper

ZooKeeper Server

Host 2

Airflow2

Airflow2 Broker

Airflow2 Flower

Airflow2 Scheduler

Airflow2 Server

Airflow2 Worker

Flink

Flink Client

Flink History Server

HBase

HBase Client

HBase Master server

HBase Phoenix query server

HBase RegionServer

HDFS

HDFS Client

HDFS DataNode

HDFS HttpFS server

HDFS JournalNode

Hive

Hive Client

Hive HiveServer2

Hive Tez

Hive TezUI

Impala

Impala Daemon

Monitoring

Prometheus Server

Node Exporter

Ozone

Ozone Manager

Ozone Storage Container Manager

Ozone Datanode

Solr

Solr Server

Solr prometheus exporter

Spark3

Spark3 Client

Spark3 Livy server

Trino

Trino Worker

Trino Client

YARN

YARN Client

YARN NodeManager

YARN ResourceManager

Zeppelin

Zeppelin Server

ZooKeeper

ZooKeeper Server

Host 3

Arenadata PostgreSQL

Flink

Flink Client

HBase

HBase Client

HBase RegionServer

HBase Thrift2 server

HBase REST Server

HDFS

HDFS Client

HDFS DataNode

HDFS JournalNode

HDFS NameNode

HDFS ZKFC

Hive

Hive Client

Hive Tez

HUE

HUE Server

Impala

Impala Daemon

Impala Client

Kyuubi

Kyuubi Server

Monitoring

Node Exporter

Ozone

Ozone Manager

Ozone Storage Container Manager

Ozone S3G

Ozone Datanode

Solr

Solr Server

Spark3

Spark3 Client

SSM

SSM Server

SSM Agent

Trino

Trino Worker

Trino Client

YARN

YARN Client

YARN NodeManager

YARN Timeline server

ZooKeeper

ZooKeeper Server

Host

Service

Component

Host 1

Core configuration

Configuration server

Flink

Flink JobManager

Flink TaskManager

Flink SQL-Gateway

HDFS

HDFS JournalNode

HDFS NameNode

HDFS ZKFC

Hive

Hive Metastore

Impala

Impala Statestore

Impala Catalog Service

Monitoring

Grafana

Node Exporter

Ozone

Ozone Manager

Ozone Storage Container Manager

Ozone Recon

Ozone HttpFS

Solr

Solr Server

Spark3

Spark3 History server

Trino

Trino Coordinator

Trino Client

YARN

MapReduce History server

ZooKeeper

ZooKeeper Server

Host 2

Airflow2

Airflow2 Broker

Airflow2 Flower

Airflow2 Scheduler

Airflow2 Server

Airflow2 Worker

HBase

HBase Master server

HBase Phoenix query server

HDFS

HDFS JournalNode

HDFS HttpFS server

Hive

Hive HiveServer2

Hive TezUI

Monitoring

Prometheus Server

Node Exporter

Ozone

Ozone Datanode

Solr

Solr Server

Solr prometheus exporter

Spark3

Spark3 Livy server

Trino

Trino Worker

Trino Client

YARN

YARN ResourceManager

Zeppelin

Zeppelin Server

ZooKeeper

ZooKeeper Server

Host 3

Arenadata PostgreSQL

HBase

HBase Thrift2 server

HBase REST Server

HDFS

HDFS NameNode

HDFS ZKFC

HDFS JournalNode

HUE

HUE Server

Kyuubi

Kyuubi Server

Monitoring

Node Exporter

Ozone

Ozone Datanode

Solr

Solr Server

SSM

SSM Server

SSM Agent

YARN

YARN Timeline server

ZooKeeper

ZooKeeper Server

Host 4

Flink

Flink Client

Flink History Server

HDFS

HDFS DataNode

HDFS Client

HBase

HBase Client

HBase RegionServer

Hive

Hive Tez

Hive Client

Impala

Impala Daemon

Impala Client

Monitoring

Node Exporter

Ozone

Ozone Manager

Ozone Storage Container Manager

Ozone Datanode

Spark3

Spark3 Client

Trino

Trino Worker

Trino Client

YARN

YARN NodeManager

YARN Client

ZooKeeper

ZooKeeper Server

Host 5

Flink

Flink Client

HBase

HBase Client

HBase RegionServer

HDFS

HDFS DataNode

HDFS Client

Hive

Hive Tez

Hive Client

Impala

Impala Daemon

Monitoring

Node Exporter

Ozone

Ozone Datanode

Spark3

Spark3 Client

Trino

Trino Worker

Trino Client

YARN

YARN NodeManager

YARN Client

ZooKeeper

ZooKeeper Server

Host 6

Flink

Flink Client

HBase

HBase Client

HBase RegionServer

HDFS

HDFS DataNode

HDFS Client

Hive

Hive Tez

Hive Client

Impala

Impala Daemon

Monitoring

Node Exporter

Ozone

Ozone Manager

Ozone Storage Container Manager

Ozone S3G

Spark3

Spark3 Client

Trino

Trino Worker

Trino Client

YARN

YARN NodeManager

YARN Client

ZooKeeper

ZooKeeper Server

Host

Service

Component

Host 1

Core configuration

Configuration server

Flink

Flink JobManager

Flink TaskManager

Flink SQL-Gateway

HDFS

HDFS JournalNode

HDFS NameNode

HDFS ZKFC

Hive

Hive Metastore

Impala

Impala Statestore

Impala Catalog Service

Monitoring

Grafana

Node Exporter

Ozone

Ozone Manager

Ozone Storage Container Manager

Ozone Recon

Ozone HttpFS

Solr

Solr Server

Spark3

Spark3 History server

Trino

Trino Coordinator

Trino Client

YARN

MapReduce History server

ZooKeeper

ZooKeeper Server

Host 2

Airflow2

Airflow2 Broker

Airflow2 Flower

Airflow2 Scheduler

Airflow2 Server

Airflow2 Worker

Flink

Flink TaskManager

HBase

HBase Master server

HBase Phoenix query server

HDFS

HDFS JournalNode

HDFS HttpFS server

Hive

Hive HiveServer2

Hive TezUI

Monitoring

Prometheus Server

Node Exporter

Solr

Solr Server

Solr prometheus exporter

Spark3

Spark3 Livy server

YARN

YARN ResourceManager

Zeppelin

Zeppelin Server

ZooKeeper

ZooKeeper Server

Host 3

HBase

HBase Thrift2 server

HBase REST Server

HDFS

HDFS NameNode

HDFS ZKFC

HDFS JournalNode

Monitoring

Node Exporter

Ozone

Ozone Manager

Ozone Storage Container Manager

Ozone Datanode

Solr

Solr Server

Trino

Trino Worker

Trino Client

YARN

YARN Timeline server

Zeppelin

Zeppelin Server

ZooKeeper

ZooKeeper Server

Host 4

Arenadata PostgreSQL

HDFS

HDFS JournalNode

HDFS NameNode

HDFS ZKFC

HDFS HttpFS server

HBase

HBase Master server

HUE

HUE Server

Kyuubi

Kyuubi Server

Monitoring

Node Exporter

Ozone

Ozone Datanode

Solr

Solr Server

SSM

SSM Server

SSM Agent

Trino

Trino Worker

Trino Client

ZooKeeper

ZooKeeper Server

Host 5

HDFS

HDFS JournalNode

HDFS NameNode

HDFS ZKFC

HBase

HBase Master server

Monitoring

Node Exporter

Ozone

Ozone Manager

Ozone Storage Container Manager

Ozone S3G

Solr

Solr Server

Trino

Trino Worker

Trino Client

ZooKeeper

ZooKeeper Server

Host 6

Flink

Flink Client

Flink History Server

HDFS

HDFS DataNode

HDFS Client

HBase

HBase Client

HBase RegionServer

Hive

Hive Tez

Hive Client

Impala

Impala Daemon

Impala Client

Monitoring

Node Exporter

Ozone

Ozone Datanode

Solr

Solr Server

Spark3

Spark3 Client

Trino

Trino Worker

Trino Client

YARN

YARN NodeManager

YARN Client

ZooKeeper

ZooKeeper Server

Host 7

Flink

Flink Client

HDFS

HDFS DataNode

HDFS Client

HBase

HBase Client

HBase RegionServer

Hive

Hive Tez

Hive Client

Impala

Impala Daemon

Monitoring

Node Exporter

Ozone

Ozone Datanode

Solr

Solr Server

Spark3

Spark3 Client

Trino

Trino Worker

Trino Client

YARN

YARN NodeManager

YARN Client

ZooKeeper

ZooKeeper Server

Host 8

Flink

Flink Client

HDFS

HDFS DataNode

HDFS Client

HBase

HBase Client

HBase RegionServer

Hive

Hive Tez

Hive Client

Impala

Impala Daemon

Monitoring

Node Exporter

Ozone

Ozone Datanode

Spark3

Spark3 Client

Trino

Trino Worker

Trino Client

YARN

YARN NodeManager

YARN Client

ZooKeeper

ZooKeeper Server

Host 9

Flink

Flink Client

HDFS

HDFS DataNode

HDFS Client

HBase

HBase Client

HBase RegionServer

Hive

Hive Tez

Hive Client

Impala

Impala Daemon

Monitoring

Node Exporter

Ozone

Ozone Datanode

Spark3

Spark3 Client

Trino

Trino Worker

Trino Client

YARN

YARN NodeManager

YARN Client

ZooKeeper

ZooKeeper Server

After component distribution is completed, click Save.

Save mapping of components

Starting with ADCM 2.2.0, you can use another mapping mode — by hosts. To do this, switch on the Hosts mode toggle and map components to hosts by clicking Add components for each host sequentially.

Use mapping by hosts

Found a mistake? Seleсt text and press Ctrl+Enter to report it