Adding components
In ADCM a component means a part of a service that should be deployed on one or several cluster hosts. For example, HDFS service can consist of such components as DataNode, NameNode, Client, and others.
IMPORTANT
Initially, there are no components on any of cluster hosts — the distribution of components between hosts should be performed manually.
|
The steps of adding components to hosts are listed below:
-
From the CLUSTERS tab switch to the cluster configuring. To do this, click the row that contains the added cluster or click the icon in the Config column. Both methods open the cluster menu.
Switching to cluster configuring -
Open the Hosts - Components tab in the cluster menu.
NOTEThe orange exclamation mark near the Hosts - Components menu item is displayed when the components distribution is needed.Switching to services components distribution -
In the opened window, distribute all necessary components between cluster hosts. To distribute components, use one of the ways:
-
Select a component in the Components column (by clicking at it) and then define all hosts for it in the Hosts column (by alternate clicking at each host).
Choosing hosts for a component -
Select a host in the Hosts column (by clicking at it) and define all components for it in the Components column (by alternate clicking at each component).
Choosing components for a host
The examples of distribution components in ADH clusters consisting of 3, 6, and 9 hosts are described in the table below. Examples are based on the Enterprise Edition of ADH.
Examples of components distributionHost Service Component Host 1
Flink
Flink Client
Flink JobManager
Flink TaskManager
HBase
HBase Client
HBase RegionServer
HDFS
HDFS Client
HDFS DataNode
HDFS JournalNode
HDFS NameNode
HDFS ZKFC
Hive
Hive Client
Hive Metastore
Hive Tez
Monitoring
Monitoring Diamond
Solr
Solr Server
Spark
Spark Client
Spark History server
Spark3
Spark3 Client
Sqoop
Sqoop Client
YARN
MapReduce History server
YARN Client
YARN NodeManager
Zookeeper
Zookeeper Server
Host 2
Airflow
Airflow Metastore
Airflow Server
Airflow broker
Flink
Flink Client
HBase
HBase Client
HBase Master server
HBase Phoenix query server
HBase RegionServer
HDFS
HDFS Client
HDFS DataNode
HDFS HttpFS server
HDFS JournalNode
Hive
Hive Client
Hive HiveServer2
Hive Tez
Hive TezUI
Monitoring
Monitoring Diamond
Solr
Solr Server
Spark
Spark Client
Spark Livy server
Spark3
Spark3 Client
Sqoop
Sqoop Client
Sqoop Metastore
YARN
YARN Client
YARN NodeManager
YARN ResourceManager
Zeppelin
Zeppelin Server
Zookeeper
Zookeeper Server
Host 3
Flink
Flink Client
HBase
HBase Client
HBase RegionServer
HBase Thrift2 server
HDFS
HDFS Client
HDFS DataNode
HDFS JournalNode
HDFS NameNode
HDFS ZKFC
Hive
Hive Client
Hive Tez
Monitoring
Monitoring Diamond
Monitoring jmxtrans
MySQL
MySQL Master server
Solr
Solr Server
Spark
Spark Client
Spark Thrift server
Spark3
Spark3 Client
Sqoop
Sqoop Client
YARN
YARN Client
YARN NodeManager
YARN Timeline server
Zookeeper
Zookeeper Server
Host Service Component Host 1
Flink
Flink JobManager
Flink TaskManager
HDFS
HDFS JournalNode
HDFS NameNode
HDFS ZKFC
Hive
Hive Metastore
Monitoring
Monitoring Diamond
Solr
Solr Server
Spark
Spark History server
YARN
MapReduce History server
Zookeeper
Zookeeper Server
Host 2
Airflow
Airflow Server
Airflow Metastore
Airflow broker
HBase
HBase Master server
HBase Phoenix query server
HDFS
HDFS JournalNode
HDFS HttpFS server
Hive
Hive HiveServer2
Hive TezUI
Monitoring
Monitoring Diamond
Solr
Solr Server
Spark
Spark Livy server
Sqoop
Sqoop Metastore
YARN
YARN ResourceManager
Zeppelin
Zeppelin Server
Zookeeper
Zookeeper Server
Host 3
HBase
HBase Thrift2 server
HDFS
HDFS NameNode
HDFS ZKFC
HDFS JournalNode
Monitoring
Monitoring Diamond
Monitoring jmxtrans
MySQL
MySQL Master server
Solr
Solr Server
Spark
Spark Thrift server
YARN
YARN Timeline server
Zookeeper
Zookeeper Server
Host 4
Flink
Flink Client
HDFS
HDFS DataNode
HDFS Client
HBase
HBase Client
HBase RegionServer
Hive
Hive Tez
Hive Client
Monitoring
Monitoring Diamond
Spark
Spark Client
Spark3
Spark3 Client
Sqoop
Sqoop Client
YARN
YARN NodeManager
YARN Client
Host 5
Flink
Flink Client
HBase
HBase Client
HBase RegionServer
HDFS
HDFS DataNode
HDFS Client
Hive
Hive Tez
Hive Client
Monitoring
Monitoring Diamond
Spark
Spark Client
Spark3
Spark3 Client
Sqoop
Sqoop Client
YARN
YARN NodeManager
YARN Client
Host 6
Flink
Flink Client
HBase
HBase Client
HBase RegionServer
HDFS
HDFS DataNode
HDFS Client
Hive
Hive Tez
Hive Client
Monitoring
Monitoring Diamond
Spark
Spark Client
Spark3
Spark3 Client
Sqoop
Sqoop Client
YARN
YARN NodeManager
YARN Client
Host Service Component Host 1
Flink
Flink JobManager
Flink TaskManager
HDFS
HDFS JournalNode
HDFS NameNode
HDFS ZKFC
Hive
Hive Metastore
Monitoring
Monitoring Diamond
Solr
Solr Server
Spark
Spark History server
YARN
MapReduce History server
Zookeeper
Zookeeper Server
Host 2
Airflow
Airflow Server
Airflow Metastore
Airflow broker
Flink
Flink TaskManager
HBase
HBase Master server
HBase Phoenix query server
HDFS
HDFS JournalNode
HDFS HttpFS server
Hive
Hive HiveServer2
Hive TezUI
Monitoring
Monitoring Diamond
Solr
Solr Server
Spark
Spark Livy server
Sqoop
Sqoop Metastore
YARN
YARN ResourceManager
Zeppelin
Zeppelin Server
Zookeeper
Zookeeper Server
Host 3
HBase
HBase Thrift2 server
HDFS
HDFS NameNode
HDFS ZKFC
HDFS JournalNode
Monitoring
Monitoring Diamond
Monitoring jmxtrans
MySQL
MySQL Master server
Solr
Solr Server
Spark
Spark Thrift server
YARN
YARN Timeline server
Zeppelin
Zeppelin Server
Zookeeper
Zookeeper Server
Host 4
HDFS
HDFS JournalNode
HDFS NameNode
HDFS ZKFC
HDFS HttpFS server
HBase
HBase Master server
Solr
Solr Server
Zookeeper
Zookeeper Server
Host 5
HDFS
HDFS JournalNode
HDFS NameNode
HDFS ZKFC
HBase
HBase Master server
Solr
Solr Server
Zookeeper
Zookeeper Server
Host 6
Flink
Flink Client
HDFS
HDFS DataNode
HDFS Client
HBase
HBase Client
HBase RegionServer
Hive
Hive Tez
Hive Client
Monitoring
Monitoring Diamond
Solr
Solr Server
Spark
Spark Client
Sqoop
Sqoop Client
YARN
YARN NodeManager
YARN Client
Host 7
Flink
Flink Client
HDFS
HDFS DataNode
HDFS Client
HBase
HBase Client
HBase RegionServer
Hive
Hive Tez
Hive Client
Monitoring
Monitoring Diamond
Solr
Solr Server
Spark
Spark Client
Sqoop
Sqoop Client
YARN
YARN NodeManager
YARN Client
Host 8
Flink
Flink Client
HDFS
HDFS DataNode
HDFS Client
HBase
HBase Client
HBase RegionServer
Hive
Hive Tez
Hive Client
Monitoring
Monitoring Diamond
Spark
Spark Client
Sqoop
Sqoop Client
YARN
YARN NodeManager
YARN Client
Host 9
Flink
Flink Client
HDFS
HDFS DataNode
HDFS Client
HBase
HBase Client
HBase RegionServer
Hive
Hive Tez
Hive Client
Monitoring
Monitoring Diamond
Spark
Spark Client
Sqoop
Sqoop Client
YARN
YARN NodeManager
YARN Client
-
-
After components distribution is completed, click Save.
Saving components distribution -
As a result, the orange exclamation mark near the menu item Hosts - Components stops being displayed.
The result of successful components distribution