Monitoring configuration parameters

Konstantin Alpashkin

To configure the service, use the following configuration parameters in ADCM.

NOTE

  • Some of the parameters become visible in the ADCM UI after the Advanced flag has been set.

  • The parameters that are set in the Custom group will overwrite the existing parameters even if they are read-only.
Prometheus settings

 

Group Parameter Description Default value

 — 

scrape_interval

Specifies how frequently to scrape targets

1m

 — 

scrape_timeout

Specifies how long to wait until a scrape request times out

10s

 — 

Password for grafana connection

Password of a Grafana user (admprom_grafana) to connect to Prometheus

 — 

 — 

Prometheus users to login/logout to Prometheus

User credentials for logging into the Prometheus web interface

 — 

Service parameters

config.file

Path to the Prometheus server configuration file

/etc/admprom/prometheus/prometheus.yml

storage.tsdb.path

Path to the Prometheus server database

/var/lib/admprom/prometheus

web.console.libraries

Path to console management libraries

/usr/share/admprom/prometheus/console_libraries

web.console.templates

Path to Prometheus server console templates

/usr/share/admprom/prometheus/consoles

web.config.file

Specifies which web configuration file to load. The file is written in YAML format

/etc/admprom/prometheus/prometheus-auth.yml

storage.tsdb.retention.time

Specifies how long to retain samples in the storage. Supported units: y, w, d, h, m, s, ms

15d

web.listen-address

Address to access the Prometheus web interface

0.0.0.0:11200
Grafana settings

 

Parameter Description Default value

Grafana administrator’s password

Password of a Grafana administrator user

 — 

Grafana listen port

Port to access the Grafana web interface

11210
Node Exporter settings

 

Parameter Description Default value

Listen port

Port to access ADH host system metrics in the Prometheus format

11203

Metrics endpoint

Endpoint to which the Node Exporter exports system metrics in the Prometheus format

/metrics
SSL configuration

 

Parameter Description Default value

[Prometheus] → Enable SSL

Defines whether SSL is enabled for Prometheus

false

[Prometheus] → Certificate file

Path to the Prometheus server SSL certificate file in the PEM format

/etc/admprom/prometheus/server.crt

[Prometheus] → Private key file

Path to the private key file of the Prometheus server SSL certificate

/etc/admprom/prometheus/server.key

[Prometheus] → Certificate authority file

Path to the certificate authority file

/etc/admprom/prometheus/ca.crt

[Grafana] → Enable SSL

Defines whether SSL is enabled for Grafana

false

[Grafana] → Certificate file

Path to the Grafana server SSL certificate file in the PEM format

/etc/admprom/grafana/server.crt

[Grafana] → Private key file

Path to the private key file of the Grafana server SSL certificate

/etc/admprom/grafana/server.key

[Grafana] → Certificate authority file

Path to the certificate authority file

/etc/admprom/grafana/ca.crt

[Node-exporter] → Enable SSL

Defines whether SSL is enabled for Node Exporter

false

[Node-exporter] → Certificate file

Path to the Node Exporter server SSL certificate file in the PEM format

/etc/ssl/server.crt

[Node-exporter] → Private key file

Path to the private key file of the Node Exporter server SSL certificate

/etc/ssl/server.key

Set SSL rights for certs/key

Enables changing the owner and permissions to the SSL certificate and key files

false
Scrape config for HDFS NameNode (hdfs_namenode_scraper.yml)

 

Parameter Description Default value

job_name

Name of the job within which metrics will be collected

hdfs-namenode

scrape_interval

Specifies how frequently to scrape targets

 — 

scrape_timeout

Specifies how long to wait until a scrape request times out. Cannot be greater than the value of the scrape_interval parameter

 — 
Scrape config for HDFS DataNode (hdfs_datanode_scraper.yml)

 

Parameter Description Default value

job_name

Name of the job within which metrics will be collected

hdfs-datanode

scrape_interval

Specifies how frequently to scrape targets

 — 

scrape_timeout

Specifies how long to wait until a scrape request times out. Cannot be greater than the value of the scrape_interval parameter

 — 
Scrape config for HDFS JournalNode (hdfs_journalnode_scraper.yml)

 

Parameter Description Default value

job_name

Name of the job within which metrics will be collected

hdfs-journalnode

scrape_interval

Specifies how frequently to scrape targets

 — 

scrape_timeout

Specifies how long to wait until a scrape request times out. Cannot be greater than the value of the scrape_interval parameter

 — 
Scrape config for Hue (hue-scraper.yml)

 

Parameter Description Default value

job_name

Name of the job within which metrics will be collected

hue_exporter

scrape_interval

Specifies how frequently to scrape targets

 — 

scrape_timeout

Specifies how long to wait until a scrape request times out. Cannot be greater than the value of the scrape_interval parameter

 — 
Scrape config for Impala Daemon (impala_daemon_scraper.yml)

 

Parameter Description Default value

job_name

Name of the job within which metrics will be collected

impala-daemon

scrape_interval

Specifies how frequently to scrape targets

 — 

scrape_timeout

Specifies how long to wait until a scrape request times out. Cannot be greater than the value of the scrape_interval parameter

 — 
Scrape config for Impala Statestore (impala_statestore_scraper.yml)

 

Parameter Description Default value

job_name

Name of the job within which metrics will be collected

impala-statestore

scrape_interval

Specifies how frequently to scrape targets

 — 

scrape_timeout

Specifies how long to wait until a scrape request times out. Cannot be greater than the value of the scrape_interval parameter

 — 
Scrape config for Impala Catalog (impala_catalog_scraper.yml)

 

Parameter Description Default value

job_name

Name of the job within which metrics will be collected

impala-catalog

scrape_interval

Specifies how frequently to scrape targets

 — 

scrape_timeout

Specifies how long to wait until a scrape request times out. Cannot be greater than the value of the scrape_interval parameter

 — 
Scrape config for Hive Metastore (hive_metastore_scraper.yml)

 

Parameter Description Default value

job_name

Name of the job within which metrics will be collected

hive-metastore

scrape_interval

Specifies how frequently to scrape targets

 — 

scrape_timeout

Specifies how long to wait until a scrape request times out. Cannot be greater than the value of the scrape_interval parameter

 — 
Scrape config for Hive Server (hive_server_scraper.yml)

 

Parameter Description Default value

job_name

Name of the job within which metrics will be collected

hive-server

scrape_interval

Specifies how frequently to scrape targets

 — 

scrape_timeout

Specifies how long to wait until a scrape request times out. Cannot be greater than the value of the scrape_interval parameter

 — 
Scrape config for Ozone (ozone_scraper.yml)

 

Parameter Description Default value

job_name

Name of the job within which metrics will be collected

ozone_exporter

scrape_interval

Specifies how frequently to scrape targets

 — 

scrape_timeout

Specifies how long to wait until a scrape request times out. Cannot be greater than the value of the scrape_interval parameter

 — 
Scrape config for Kyuubi (kyuubi_scraper.yml)

 

Parameter Description Default value

job_name

Name of the job within which metrics will be collected

kyuubi_exporter

scrape_interval

Specifies how frequently to scrape targets

 — 

scrape_timeout

Specifies how long to wait until a scrape request times out. Cannot be greater than the value of the scrape_interval parameter

 — 
Scrape config for YARN nodemanager (yarn_nodemanager_scraper.yml)

 

Parameter Description Default value

job_name

Name of the job within which metrics will be collected

yarn-nodemanager

scrape_interval

Specifies how frequently to scrape targets

 — 

scrape_timeout

Specifies how long to wait until a scrape request times out. Cannot be greater than the value of the scrape_interval parameter

 — 
Scrape config for YARN resourcemanager (yarn_resourcemanager_scraper.yml)

 

Parameter Description Default value

job_name

Name of the job within which metrics will be collected

yarn-resourcemanager

scrape_interval

Specifies how frequently to scrape targets

 — 

scrape_timeout

Specifies how long to wait until a scrape request times out. Cannot be greater than the value of the scrape_interval parameter

 — 
Scrape config for YARN timelineserver (yarn_timelineserver_scraper.yml)

 

Parameter Description Default value

job_name

Name of the job within which metrics will be collected

yarn-timelineserver

scrape_interval

Specifies how frequently to scrape targets

 — 

scrape_timeout

Specifies how long to wait until a scrape request times out. Cannot be greater than the value of the scrape_interval parameter

 — 
Found a mistake? Seleсt text and press Ctrl+Enter to report it