adc export hadoop-config

Sergei Tikhomirov

Definition

Exports rendered configuration for Hadoop and Ranger.

Usage

$ adc export hadoop-config -f <file> \
                           [--name <name>] \
                           [--output-dir <dir>]
Arguments
Parameter Description

-f, --file

Path to a cluster configuration file

--name

Cluster release name. Used to derive the Kerberos principal in Ranger XML. The default value is adc

--output-dir

Output directory for the XML files. Created if it doesn’t exist. By default, the output is saved to the current working directory

Examples

Exporting the Trino cluster configuration:

$ adc export hadoop-config -f trino-cluster.yaml --name trino --output-dir ./trino

The generated trino directory contains the following files:

core-site.xml
<configuration>
  <property>
    <name>dfs.client.failover.proxy.provider.adh</name>
    <value>org.apache.hadoop.hdfs.server.namenode.ha.ObserverReadProxyProvider</value>
  </property>
  <property>
    <name>dfs.ha.namenodes.adh</name>
    <value>nn_tsn-adh-k8s-1,nn_tsn-adh-k8s-3</value>
  </property>
  <property>
    <name>dfs.namenode.rpc-address.adh.nn_tsn-k8s-1</name>
    <value>tsn-adh-k8s-1.ru-central1.internal:8020</value>
  </property>
  <property>
    <name>dfs.namenode.rpc-address.adh.nn_tsn-k8s-3</name>
    <value>tsn-adh-k8s-3.ru-central1.internal:8020</value>
  </property>
  <property>
    <name>dfs.nameservices</name>
    <value>adh</value>
  </property>
  <property>
    <name>fs.defaultFS</name>
    <value>hdfs://adh</value>
  </property>
  <property>
    <name>hadoop.proxyuser.trino.groups</name>
    <value>*</value>
  </property>
  <property>
    <name>hadoop.proxyuser.trino.hosts</name>
    <value>*</value>
  </property>
  <property>
    <name>hadoop.security.authentication</name>
    <value>simple</value>
  </property>
  <property>
    <name>ozone.om.address.adh.om_tsn-k8s-1</name>
    <value>tsn-adh-k8s-1.ru-central1.internal:9862</value>
  </property>
  <property>
    <name>ozone.om.address.adh.om_tsn-k8s-2</name>
    <value>tsn-adh-k8s-2.ru-central1.internal:9862</value>
  </property>
  <property>
    <name>ozone.om.address.adh.om_tsn-k8s-3</name>
    <value>tsn-adh-k8s-3.ru-central1.internal:9862</value>
  </property>
  <property>
    <name>ozone.om.nodes.adh</name>
    <value>om_tsn-adh-k8s-1,om_tsn-adh-k8s-2,om_tsn-adh-k8s-3</value>
  </property>
  <property>
    <name>ozone.om.service.ids</name>
    <value>adhom</value>
  </property>
</configuration>
hive-site.xml
<configuration>
  <property>
    <name>hive.metastore.sasl.enabled</name>
    <value>false</value>
  </property>
  <property>
    <name>hive.metastore.uris</name>
    <value>thrift://tsn-adh-k8s-1.ru-central1.internal:9083</value>
  </property>
  <property>
    <name>metastore.use.SSL</name>
    <value>false</value>
  </property>
</configuration>
Found a mistake? Seleсt text and press Ctrl+Enter to report it