Products
Arenadata DB
Arenadata Hyperwave
Arenadata QuickMarts
Arenadata Streaming
Arenadata Postgres
Arenadata Cluster Manager
Download
Documentation releases
Technical blog
Career
PDF DOCS
Submitting feedback
Thank you for rating our AI Search!
We would be grateful if you could share your thoughts so we can improve our AI Search for you and other readers.
Thank you for your time!
Your feedback will help us improve AI Search experience.
Smart Search
AI Helper
Read article
Hello, I’m Arenadata AI!
Smart Search
AI Helper
Answer cancelled by user
Sources
--placeholder--
--placeholder--
I’m an AI Helper trained on Arenadata documentation. What do you want to know?
Example
Select language
EN
|
RU
Change color mode
Home
Products
ADB
Arenadata Hyperwave
Select version
4.1.0
4.1.0
4.1.0
4.0.0
3.3.6.2
3.3.6.1
3.2.4.3
3.2.4.2
3.2.4.1
3.1.2.1
2.1.10
2.1.8
2.1.7
Concepts
Supported table formats
Iceberg
Security
Kerberos
Planning guide
Filesystem requirements
Network requirements
Software requirements
Custom Java settings
Get started
Online installation
Install ADCM
Prepare hosts
Install ADH cluster
Create a cluster
Add services
Add hosts to a cluster
Add components
Configure services
Configure a cluster
Install a cluster
Install monitoring
Way 1. Monitoring service
Way 2. Monitoring cluster
Create a cluster
Add services
Add hosts to a cluster
Add components
Configure services
Install a cluster
Integrate with ADH cluster
Offline installation
Install ADCM
Prepare hosts
Install Enterprise Tools cluster
Create a cluster
Add services
Add hosts to a cluster
Add components
Install a cluster
Install ADH cluster
Create a cluster
Add services
Add hosts to a cluster
Add components
Configure services
Configure a cluster
Import ET settings
Install a cluster
Install monitoring
Way 1. Monitoring service
Way 2. Monitoring cluster
Configure Enterprise Tools cluster
Integrate with ADH cluster
Services
ADPG
Configuration parameters
Service management via ADCM
Airflow
Architecture
Connect to Airflow
CLI
REST API
Web user interface
Work with DAGs
Create a simple DAG
Work with TaskFlow
Use sensors
Customize DAG scheduling
Add custom operators and hooks
Generate DAGs dynamically
Logging
Service management via ADCM
Configuration parameters
Core configuration
Get client configurations
Service management via ADCM
Configuration parameters
Flink
Architecture
Connect to Flink
CLI
PyFlink
Web user interface
Flink SQL Gateway
Flink on YARN
Logging
Performance tuning
Build a streaming ETL with Flink
Service management via ADCM
Flink
Flink2
Configuration parameters
Flink
Flink2
HBase
Overview
Architecture
Data model
Connect to HBase
Connection methods
Use native API
Use external API
Access management
Ranger plugin
Web user interface
Data management
Quick start
Use filters
Use coprocessors
Scan over snapshot
Use medium-sized objects
Bulk loading
Process overview
Built-in MapReduce jobs
Maintenance
Replication
Backup and restore
Logging
Use snapshots
Performance tuning
Service management via ADCM
Service references
Configuration parameters
HBase shell commands
General
processlist
status
table_help
version
whoami
DDL
alter
alter_async
alter_status
create
describe
disable
disable_all
drop
drop_all
enable
enable_all
exists
get_table
is_enabled
is_disabled
list
list_regions
locate_region
show_filters
Namespace
alter_namespace
create_namespace
describe_namespace
drop_namespace
list_namespace
list_namespace_tables
DML
append
count
delete
deleteall
get
get_counter
get_splits
incr
put
scan
truncate
truncate_preserve
Tools
assign
balancer
balancer_enabled
balance_switch
catalogjanitor_enabled
catalogjanitor_run
catalogjanitor_switch
cleaner_chore_enabled
cleaner_chore_run
cleaner_chore_switch
clear_block_cache
clear_compaction_queues
clear_deadservers
close_region
compact
compaction_state
compact_rs
flush
is_in_maintenance_mode
list_deadservers
major_compact
merge_region
move
normalize
normalizer_enabled
normalizer_switch
split
splitormerge_enabled
splitormerge_switch
trace
unassign
wal_roll
zk_dump
Replication
add_peer
append_peer_namespaces
append_peer_tableCFs
disable_peer
disable_table_replication
enable_peer
enable_table_replication
get_peer_config
list_peers
list_peer_configs
list_replicated_tables
remove_peer
remove_peer_namespaces
remove_peer_tableCFs
set_peer_bandwidth
set_peer_exclude_namespaces
set_peer_exclude_tableCFs
set_peer_namespaces
set_peer_replicate_all
set_peer_tableCFs
show_peer_tableCFs
update_peer_config
Snapshots
clone_snapshot
delete_all_snapshot
delete_snapshot
delete_table_snapshots
list_snapshots
list_table_snapshots
restore_snapshot
snapshot
Configuration
update_all_config
update_config
Quotas
list_quotas
list_snapshot_sizes
list_quota_snapshots
list_quota_table_sizes
set_quota
Security
grant
list_security_capabilities
revoke
user_permission
Procedures
abort_procedure
list_locks
list_procedures
Visibility labels
add_labels
clear_auths
get_auths
list_labels
set_auths
set_visibility
Rsgroup
add_rsgroup
balance_rsgroup
get_rsgroup
get_server_rsgroup
get_table_rsgroup
list_rsgroups
move_namespaces_rsgroup
move_servers_rsgroup
move_servers_namespaces_rsgroup
move_servers_tables_rsgroup
move_tables_rsgroup
remove_rsgroup
remove_servers_rsgroup
HDFS
Architecture
Connect to HDFS
Web user interface
Access management
Ranger plugin
Data management
Basic file operations
Protect files
Copy data to HDFS
Add HDFS data directories
DataNode hot swapping
Remove files and directories
Enable WebHDFS
Check files via fsck
Local read
Use distcp
Use HttpFS
Storage management
Storage policies
Use quotas
Cache management
Integration with S3
Maintenance
Replication
Replication factor
Rack awareness
Erasure coding
NameNode safemode
Backup and restore
Snapshots
NameNode recovery
Checkpointing
Logging
Configure
Use Observer NameNode
Service management via ADCM
Service references
Configuration parameters
Hadoop Command-line
Hadoop CLI
User commands
archive
checknative
CLASSNAME
classpath
conftest
credential
distch
distcp
dtutil
envvars
fs
gridmix
jar
jnipath
kerbname
kdiag
key
kms
trace
version
Administration commands
daemonlog
HDFS CLI
User commands
classpath
dfs
envvars
fetchdt
fsck
getconf
groups
httpfs
lsSnapshottableDir
jmxget
oev
oiv
oiv_legacy
snapshotDiff
version
Administration commands
balancer
cacheadmin
crypto
datanode
dfsadmin
dfsrouter
dfsrouteradmin
diskbalancer
ec
haadmin
journalnode
mover
namenode
nfs3
portmap
secondarynamenode
storagepolicies
zkfc
Debug commands
computeMeta
recoverLease
verifyMeta
FileSystem shell
appendToFile
cat
checksum
chgrp
chmod
chown
copyFromLocal
copyToLocal
count
cp
createSnapshot
deleteSnapshot
df
du
dus
expunge
find
get
getfacl
getfattr
getmerge
head
help
ls
lsr
mkdir
moveFromLocal
moveToLocal
mv
put
renameSnapshot
rm
rmdir
rmr
setfacl
setfattr
setrep
stat
tail
test
text
touch
touchz
truncate
usage
HDFS cheatsheet
Hive
Requirements for PostgreSQL used as Hive Metastore
Connect to Hive
Beeline shell
JDBC
Web user interface
Access management
Ranger plugin
Data management
Data querying
Work with tables
Computation example
Multi-table inserts
Analyze queries
Query types
Subqueries
Aggregate functions
Windowing functions
Use materialized views
Iceberg tables
Maintenance
Backup and restore
High availability
Use ACID
Logging
Performance tuning
Service management via ADCM
Integrations
Hive on Spark
Hive with HBase
TEZ
Overview
View a Hive job
Service references
Configuration parameters
Hive on Spark parameters
Beeline command line
HUE
Access management
SPNEGO authentication
Web user interface
Add and use an interpreter
Iceberg tables
Service management via ADCM
Configuration parameters
Impala
Architecture
Connect to Impala
impala-shell
JDBC
Access management
LDAP authentication
Ranger plugin
Web user interface
Performance tuning
Integrations
Impala with Hive
Impala with HBase
Iceberg tables
Service management via ADCM
Service references
Configuration parameters
Impala shell commands
Kyuubi
Overview
Architecture
Kyuubi vs HiveServer vs Spark Thrift Server
Share levels
Access management
LDAP authentication
Web user interface
Service management via ADCM
Configuration parameters
MapReduce
Overview
Architecture
Working principle
Quick start
Connect to MapReduce
CLI
REST API
Logging
Pluggable shuffle and sort
Encrypted shuffle
Service references
MapReduce CLI
User commands
archive
archives-logs
classpath
distcp
envvars
job
pipes
queue
version
Administration commands
frameworkuploader
historyserver
hsadmin
Monitoring
Architecture
Service management via ADCM
Service references
Configuration parameters
ADH monitoring metrics
Ozone
Overview
Architecture
HDFS vs Ozone
Connect to Ozone
CLI
Access management
Ranger plugin
Web user interface
Ozone integration with cluster services
Rack awareness
Service management via ADCM
Service references
Configuration parameters
Ozone CLI
bucket
addacl
clrquota
create
delete
getacl
info
link
list
removeacl
set-replication-config
setacl
setquota
update
key
addacl
cat
checksum
cp
delete
get
getacl
info
list
put
removeacl
rename
setacl
prefix
addacl
getacl
removeacl
setacl
snapshot
create
delete
diff
info
list
listDiff
token
cancel
get
print
renew
user
assign-admin
assign
get-secret
info
list
revoke-admin
revoke
set-secret
volume
addacl
clrquota
create
delete
getacl
info
list
removeacl
setacl
setquota
update
Phoenix
Overview
Connect to Phoenix
Data management
Data querying
Use SQLLine
JOIN
Subqueries
Sequences
Use salted tables
Map with HBase tables
Bulk loading
Performance tuning
Logging
Solr
Architecture
Connect to Solr
CLI
Web user interface
Access management
Ranger plugin
Solr collections
Indexing
Overview
Index nested documents
Partial document updates
Reindex data
Deduplication
Maintenance
Logging
Performance tuning
Service management via ADCM
Configuration parameters
Spark
Architecture
Connect to Spark
spark3-submit and spark3-shell
Spark Connect
Access management
Spark3 Ranger plugin
Data management
In-memory batch processing
Dataset
RDD
DataFrame
Iceberg tables
Overwrite non-partitioned Hive tables
Integrations
Spark and Hive
ADB Spark 3 Connector
Overview
Prerequisites
Usage examples
Options
ADQM Spark 3 Connector
Overview
Prerequisites
Usage example
Options
PySpark
Spark Connect
Work with Livy
Maintenance
Scheduler jobs
Logging
Performance tuning
Service management via ADCM
Spark3
Spark4
Service references
Configuration parameters
Spark3
Spark4
spark-shell
spark-submit
SSM
Architecture
Web user interface
Rules and actions
Define rules
Define actions
Rule usage examples
Service management via ADCM
Service references
Configuration parameters
Actions
Rules
Trino
Architecture
Connect to Trino
CLI
JDBC
Web user interface
Access management
LDAP authentication
Kerberos authentication
Ranger plugin
Ranger authorization with Hive policies
Credential propagation
Maintenance
Trino catalogs
Catalog management
Use DBCatalogManager
Manage fault-tolerant execution
Trino Сoordinator high availability
Service management via ADCM
Integrations
Overview of Trino connectors
Iceberg catalog
Hive catalog
Trino ADB connector
Overview
Prerequisites
Usage example
Trino OpenAPI connector
Overview
Usage example
Configuration
Configuration parameters
YARN
Architecture
Access management
Ranger plugin
Connect to YARN
CLI
REST API
Web user interface
Schedulers
FairScheduler
CapacityScheduler
Maintenance
High availability
Overview
Examples
Logging
GPU on YARN
Service management via ADCM
Service references
Configuration parameters
YARN CLI
User commands
application
applicationattempt
classpath
container
envvars
jar
logs
node
queue
top
version
Administration commands
daemonlog
nodemanager
proxyserver
registrydns
resourcemanager
rmadmin
schedulerconf
scmadmin
sharedcachemanager
timelineserver
Zeppelin
Architecture
Web user interface
Maintenance
Logging
Performance tuning
Service management via ADCM
Work with interpreters
Add a custom interpreter to a group
Install a third-party interpreter
User-managed interpreters
Write a new interpreter
Examples of notes
Phoenix
Solr
Spark
Python
Configuration parameters
ZooKeeper
Architecture
Connect to ZooKeeper
CLI
API
Work with znodes
Maintenance
Logging
Configure
Service management via ADCM
Configuration parameters
Cluster-level operations
Cluster management via ADCM
Cluster actions
Check
Manage SSL
Manage Credential Encryption
Manage Kerberos
Prepare hosts
Reinstall status-checker
Start
Stop
Upgrade
Hosts actions
Add a host to a cluster
View host status
Remove a host from a cluster
Service actions
Security
ADPS
Overview
Ranger plugins
Kerberos
Overview
MIT Kerberos
Kerberos server settings
Configure via ADCM
MS Active Directory
Install AD Certification Service
Create certificate template
Issue certificate template
Request a new certificate
Export CA certificate
Configure via ADCM
Enable Kerberos with prepared Active Directory server and no admin permissions
AD Kerberos common problems
FreeIPA
Overview
Configure via ADCM
Enable Kerberos with prepared FreeIPA server and no admin permissions
Samba
Configure via ADCM
Connect to Hive from DBeaver with Kerberos
SPNEGO
SSL
Requirements for SSL certificates
Set TLS version
Impersonation settings in ADH
References
Configuration parameters
Glossary
Release notes
ADH releases
Supported services
Version compatibility matrix
Known issues
ADQM
ADS
ADPG
ADCM
ADPS
hp-ssh
hp-yandex
hp-croc
hp-cloudru
hp-vmware
hp-adqmcloud
hp-adbcloud
ADSCONTROL
ADQMCONTROL
ADPGCONTROL
Products
Arenadata DB
Arenadata Hyperwave
Arenadata QuickMarts
Arenadata Streaming
Arenadata Postgres
Arenadata Cluster Manager
Download
Documentation releases
Technical blog
Career
PDF DOCS
Submitting feedback
Thank you for rating our AI Search!
We would be grateful if you could share your thoughts so we can improve our AI Search for you and other readers.
Thank you for your time!
Your feedback will help us improve AI Search experience.
Smart Search
AI Helper
Read article
Hello, I’m Arenadata AI!
Smart Search
AI Helper
Answer cancelled by user
Sources
--placeholder--
--placeholder--
I’m an AI Helper trained on Arenadata documentation. What do you want to know?
Example
Select language
EN
|
RU
Change color mode
Home
Arenadata Hyperwave
Found a mistake? Seleсt text and press
Ctrl+Enter
to report it