Added Release notes for the 3.12.1 hostprovider version.
Reflected changes in the ADS release 3.7.2.1.b1 dated 21.04.2025:
Added Release notes.
Actualized ADS supported services and Version compatibility matrix.
Added the Kafka migration to KRaft article.
In the Kafka section of the ADS configuration parameters article:
Described the KRaft migration mode parameter.
Added the Rolling restart safety checks and Custom listeners subsections.
In the following articles, described the Add/Remove components service action, which replaced Expand and Shrink:
Added the KRaft migration stage section to the Kafka actions article.
In the Configure a cluster article:
Described the arenadata_java parameter in the Primary configuration → Repositories section.
Updated other parameters.
Mentioned Iceberg Sink Connector in the Kafka Connect overview article.
Removed all mentions of the Kafka-Manager service.
Added MiNiFi overview.
Actualized ADS configuration parameters.
Reflected changes in the ADPG release 16.3.3 dated 15.04.2025:
Added Release notes.
Described the monitoring system changes in the following articles:
Described Patroni basic auth in the ADPG high availability overview article.
In the Supported extensions article, described the following extensions: pg_orphaned, pg_repack, pg_vector, timescaledb_toolkit.
Updated ADPG known issues.
Added new articles:
In the ADPG → ADPG configurations → Custom postgresql.conf section of the Configuration parameters article, described parameters that cannot be changed via Custom postgresql.conf.
In the Backup storages section of the Backup and restore using pgBackRest article, added more details to the note with information on POSIX storage configuration.
Added Release notes for the ADB release 6.27.1.61 dated 14.04.2025.
Reflected changes in the ADCM release 2.6.0 dated 03.04.2025:
Added Release notes.
In the Bundle DSL article:
In the actions → config_jinja section, described the groups variable.
In the config → Configuration parameters properties section, described the ansible_options parameter and the unsafe option.
In the actions section, described the allow_for_action_host_group parameter.
In the components section, added a note for the bound_to parameter.
Removed the outdated Groups for special action operations section from the Ansible inventory groups article.
Added new articles:
Added the Offline update section to the Upgrade article.
In the Create a host group section of the Set up host groups for actions article, fixed the text under the Hosts added to the group image.
In all Russian texts, replaced проблема by concern.
Reflected changes in the ADQM release 24.8.8.17.2.b1 dated 24.03.2025:
Updated the Monitoring service article:
Actualized all images.
Updated the introduction text.
Updated the Monitoring service components table in the Step 2. Add components section.
In the Step 3. Configure the service section, added a note about the Metrics activatable section.
Changed default port numbers in the Step 5. View results section.
In the Configuration parameters article:
Added parameters to the Monitoring → Prometheus settings → Service parameters section.
Added a note to the ADQMDB → Encryption codecs for tables section.
In the Usage of clickhouse-copier article, mentioned that clickhouse-copier does not work with the Variant, Dynamic, and JSON data types.
Updated the Network requirements article:
Divided the table with ports into the following tabs (one tab per product): ADQM, Monitoring, Enterprise Tools, ADCM.
Actualized ADQM ports.
Added the Enterprise Tools (ET) description to the Offline installation article.
Added the Arenadata Enterprise Tools ports and Arenadata Monitoring ports sections to the ADH network ports article.
Added the Enterprise Tools (ET) description to the Offline installation article.
Added the Arenadata Enterprise Tools and Arenadata Monitoring sections to the Hardware requirements article.
Added the Arenadata Enterprise Tools ports and Arenadata Monitoring ports sections to the Network requirements article.
Added the Enterprise Tools (ET) description to the Offline installation article.
Added the Arenadata Enterprise Tools and Arenadata Monitoring sections to the Hardware requirements article.
Added the Enterprise Tools (ET) description to the Get started with Arenadata Streaming Control article.
Added the Enterprise Tools (ET) description to the Offline installation article.
Added the Arenadata Enterprise Tools and Arenadata Monitoring sections to the Hardware requirements article.
Added the Enterprise Tools (ET) description to the Offline installation article.
Added the Arenadata Enterprise Tools and Arenadata Monitoring sections to the Hardware requirements article.
Added the Arenadata Enterprise Tools ports and Arenadata Monitoring ports sections to the Network requirements article.
Added the Stream statuses schema to the View active streams section of the Disaster recovery article.
Reflected changes in the ADQM release 24.8.8.17.2.b1 dated 24.03.2025:
Added Release notes.
Described the Manage SSL cluster action in the Enable SSL encryption article.
Updated the example in the SSL certificate authentication article.
Actualized the Configuration parameters article:
Updated the following sections and parameters:
ADQMDB → SSL Configuration
ADQMDB → Intra-cluster communication security → Enable secure intra-cluster communication
Chproxy → Network configuration → Use HTTP to connect to ADQMDB
Zookeeper → SSL configuration
Monitoring → Prometheus settings
ADQMDB → Encryption codecs for tables
Added the following sections:
ADQMDB → Metrics
Zookeeper → Metrics
Clickhousekeeper → Metrics
Removed the Monitoring → ADQM’s services metric settings section.
In the Proxying article, updated the prefix* template in the description of the Proxy wildcarded users → List of user names field.
Added the Example of connecting ADQM to HDFS of a kerberized ADH cluster section to the Integration between ADQM and HDFS article.
Added the Example of connecting ADQM to Kafka with Kerberos SASL section to the Integration between ADQM and Kafka article.
Added the Enterprise Tools (ET) description to the Offline installation article.
Added the Arenadata Enterprise Tools and Arenadata Monitoring sections to the Hardware requirements article.
Reflected changes in the ADS Control release 2.4.0.b1 dated 17.03.2025:
Added Release notes.
Added LDAP authentication.
In the Work with topics in ADS Control article:
Described the Tiered storage parameter in the Topics page overview section.
Updated the Create a topic and Configuration tab sections.
Added the Version compatibility matrix article.
In the Create a cluster article, actualized the Step 1. Download a cluster bundle section.
Added Release notes for the ADB release 6.27.1.60 dated 07.03.2025.
In the Software requirements article, renamed the Requirements for Astra Linux section to Requirements for Astra Linux and Ubuntu.
In the Create a cluster article, actualized the Step 1. Download a cluster bundle section.
Reflected changes in the ADB Control release 4.12.0 dated 07.03.2025:
Added Release notes.
Added the Metrics section to the General settings article.
In the Monitoring of commands article:
In the Command details → Performance section, updated images and described the Spill size and Spill files number metrics in the Fields of the table with segment metrics table.
In the System metrics collected for commands section, actualized metrics of the Spill files group.
In the LDAP authentication article, updated the image and note under the table.
Reflected changes in the ADBM release 2.4.0 dated 07.03.2025:
Added Release notes.
In the Add a new configuration → Repository section of the Manage configurations in ADBM article, updated the image and described the following parameters:
Server-side encryption options
Type
Key
In the View backups in ADBM article, updated all images. Also, described the backup progress bar in the Backup list fields, Fields of the Topology section tables and in the Backup details section.
In the Disaster recovery article:
Updated all images.
Described the On restore points streaming failure field and its possible values Pause and Bring online.
Updated possible values of the Restore mirrors field.
In the View active streams section, described the Pause and Copying statuses.
In the View finished streams section, described the Cancelled status.
In the View the stream details section, described the Mirrors restore mode and Error handling mode fields and the Status field with possible values.
Added the Resume a stream and Cancel a stream sections.
In the Run actions in ADBM article:
Updated all images starting with the Backup section.
In the Backup section, described the backup progress bar.
In the Common restore section, updated the Restore mirrors field values.
Actualized the ADBM known issues article.
In the ADBM ports section of the Network requirements article, fixed the port number for Service Registry (from 6568 to 6567).
In the Partial restore section of the Run actions in ADBM article, fixed the Table name masks field description.
In the Configure and use Kafka Tiered Storage article:
Added the Simple Storage Service (S3) section.
Fixed the description under the Kafka Tiered Storage image.
Added the Raft algorithm and Metadata management sections to the KRaft overview article.
In the Prerequisites section of the Ranger NiFi plugin article, added information about the ranger.usersync.ldap.groupname.caseconversion and ranger.usersync.ldap.username.caseconversion parameters.
Added Release notes for the ADCM release 2.5.1 dated 26.02.2025.
In the Prepare hosts article, described the maximum FQDN length for ADH hosts. Also, added this information to the documentation of the following hostproviders:
In the Software requirements article, changed the supported versions of CentOS and RHEL to 7.9.
In the Enable encryption for a service section of the Manage Credential Encryption article, added information on the Update jceks parameter.
In the Create a cluster article, actualized the Step 1. Download a cluster bundle section.
Added Logging in Knox.
In the Prepare hosts article, described the maximum FQDN length for ADPS hosts. Also, added this information to the documentation of the following hostproviders:
In the Software requirements article, changed the supported versions of CentOS and RHEL to 7.9.
In the Solr section of the Password encryption article, added a note with information on how to activate password encryption for Solr.
In the Prepare hosts article, described the maximum FQDN length for ADS hosts. Also, added this information to the documentation of the following hostproviders:
In the Software requirements article, changed the supported versions of CentOS and RHEL to 7.9.
In the Create a cluster article, actualized the Step 1. Download a cluster bundle section.
Added new articles:
Updated the Enable SSL encryption article (starting with ADQM 22.8.6.71):
Mentioned the minimum openssl version (1.1.1).
In all examples, changed paths from /etc/clickhouse-server/ to /etc/clickhouse-server/certs/.
Added step 6 to the Create SSL certificates section.
Updated the image in the Configure ADQM to enable SSL encryption section.
In the Test connection section, described how to test the connection to ADQM over HTTPS.
In the Configuration parameters article:
Updated the ADQMDB → SSL → Client certificate verification mode parameter default value (starting with ADQM 23.3.2.37).
Fixed some misprints.
In the Create a cluster article, actualized the Step 1. Download a cluster bundle section.
Added Release notes for the ADS release 3.6.2.2.b2 dated 06.02.2025.
Described KRaft:
In the Install a cluster article, mentioned that Kafka installation in the KRaft mode requires additional steps and added a link to Kafka installation in the KRaft mode
Described Kafka Tiered Storage:
Described new Kafka parameters in the ADS configuration parameters article:
Host index matching
Kafka quorum solution
core-site config template
HDFS Tiered Storage
S3 Tiered Storage
Tiered Storage General
Kafka Controller component parameters
Removed the Hive installation features section from the Install a cluster article (starting with ADH 3.3.6.1).
Reflected changes in the ADH release 3.3.6.2.b1 dated 31.01.2025:
Added Release notes.
Actualized Supported services and Version compatibility matrix.
Added information about RED OS 7.3 support to Software requirements.
Described the Trino service:
Description of Trino ports in the ADH network ports article
Trino service description in the Add services article
Examples of mapping Trino components in the Add components article
TRINO_JAVA_HOME description in the Configure a cluster article
Trino options in the Configuration parameters article
Described the Ozone service:
Description of Ozone ports in the ADH network ports article
Ozone service description in the Add services article
Examples of mapping Ozone components in the Add components article
Ozone options in the Configuration parameters article
Described the Core configuration service:
Service description in the Add services article
Service options in the Configuration parameters article
Described the Add/Remove components action and removed actions replaced by it for the following services:
In the ADH network ports article, updated the port number for SSM Smart Agent.
Added articles for the HBase service:
Added articles for the Solr service:
Added articles for the Airflow service:
Added Logging in Zeppelin.
Added SPNEGO authentication.
Added ADH known issues.
Updated Configuration parameters.
In the Configure a cluster article, fixed the Custom keytab recommendations link.
Reflected changes in the ADPS release 1.2.1.b1 dated 31.01.2025:
Added Release notes.
Actualized Supported services.
Added information about RED OS 7.3 support to Software requirements.
Described the Add/Remove components action for Knox and Solr.
Added new articles:
In the Configure an external PostgreSQL database for Ranger metadata article, fixed information about the JDBC driver installation.
Reflected changes in the ADPG release 16.3.2 dated 16.01.2025:
Added Release notes.
In the Software requirements article, mentioned ADCM 2.3.0 as a minimal required version and added information about support of RED OS 7.3 Certified edition.
Actualized the Upgrade a cluster to a new ADPG version article:
Described the Stop the job button.
Described the major upgrade process for an ADPG cluster with two or more replicas.
Described the Run backup after upgrade option.
Explained that it is prohibited to change the cluster configuration between major upgrade steps.
In the Configuration parameters article:
Added the ADPG → Patroni ADPG tags section.
Updated the ADPG → ADPG configurations section: described the postgresql.conf and Custom postgresql.conf fields.
Removed the Reconfigure & Reload action description from all articles and updated screenshots related to this action.
Removed the requirement to install additional packages for the procedural languages (PL/Perl, PL/PerlU, PL/Python3U, PL/Tcl, PL/TclU) from all articles.
In the ADPG high availability overview article, described the Info tab for ADPG.
In all articles, renamed the use_custom_location parameter to use_custom_patroni_log_dir.
Updated ADPG known issues.
Added new articles:
Added Release notes for the 3.12 hostprovider version.
Reflected changes in the ADCM release 2.5.0 dated 28.12.2024:
Added Release notes.
Added the Possibility of parallel running actions using non-blocking concerns section to the Concerns article.
In the Launch actions section of the ADCM API v2 usage examples article, described the shouldBlockObject parameter.
Added new articles:
Reflected changes in the ADB release 6.27.1.59 dated 27.12.2024:
Added Release notes.
In the Cluster actions article, described the Move Host Segment action.
Reflected changes in the ADB Control release 4.11.0 dated 27.12.2024:
Added Release notes.
In the SSL encryption article:
Added the External databases section.
Updated all images and names of default certificates.
Renamed HTTPS parameters enable to SSL.
Described the CA certificate field.
Added information on how to configure pg_hba.conf for SSL to the following articles:
The Metrics offload section of the Configure job policies article.
In the ClickHouse section of the Configure external databases for ADB Control article, added information about SSL settings and updated the image.
Reflected changes in the ADBM release 2.3.2 dated 27.12.2024:
Added Release notes.
Removed etcd from the architectural schema in the Arenadata DB Backup Manager overview article and assigned its functions to PostgreSQL.
For the backup report command in the Work with ADBM CLI article, described the --output option and divided the usage example into two parts: for text and JSON.
In the Run actions in ADBM article:
Added the Create configuration section.
Before the description of all actions in the Action types section, added a note about allowed actions.
At the end of the Partial restore section, added the third list item to the CAUTION block (about Table name masks).
In the Add a new configuration section of the Manage configurations in ADBM article, added a note to the Workspace → Temporary directory field description.
In the Disaster recovery article, added the third list item to the first note (about compatibility of operating systems).
In the Action details section of the View actions in ADBM article, updated images.
In the Restore details section of the View restores in ADBM article, updated images and described filters, sorting, and pagination.
Actualized ADBM known issues.
Reflected changes in the ADS release 3.6.2.2.b1 dated 27.12.2024:
Added Release notes.
Actualized ADS supported services and Version compatibility matrix.
Added the Online installation → Install monitoring → Way 1. Monitoring service article, which describes the Monitoring service based on Prometheus. The article was also copied to Offline installation without any changes.
In the Online installation → Install monitoring and Offline installation → Install monitoring sections, described two ways to install ADS monitoring — via the new monitoring service or the monitoring cluster (Enterprise Tools cluster in case of offline installation). Added information that the second way (via a separate cluster) is currently suspended and will be completely discontinued in future ADS releases.
Added Debezium overview.
Added new articles:
In the NiFi actions and Cluster actions articles, added a note about the FAILED - RETRYING messages on the Jobs page in ADCM.
Added new articles:
At the end of the Enable SSL encryption article, added a clarification on how to apply configuration settings in ADCM.
In the Work with ADBM CLI article:
For the --database option of the backup ls command, described the -d shortcut.
For the --dbname option of the backup create command, described the --database alias and the -d shortcut.
In the ADB Control ports section of the Network requirements article:
Added the 5701 port to the ADB hosts tab.
On the ADB Control host tab, removed the Router and Web UI services and moved the 81 port to the UI Backend Server ports.
Removed Web UI and Router from the architectural schema in the Arenadata DB Control overview article.
In all places of the ADB Control documentation where metrics for virtual memory are mentioned, renamed consumption to allocation.
Fixed some misprints in the ADB Control 4.10.3 release notes.
Renamed the Requirements article to Software requirements. Also, applied the following changes to this article:
Added recommendations on the ADCM version.
Specified supported version numbers for CentOS and RHEL.
Described requirements for the default network route.
At the beginning of the article, added information about CentOS support.
In the articles that describe how to prepare hosts during online and offline installation, added information on how to check and set the default network route.
In the Upgrade a cluster to a new ADPG version article, extended the first note and actualized the Upgrade of a major version section.
Extended the list of known issues for ADPG 16.3.1.
Added new articles:
In the Software requirements article, changed the RED OS supported version to 7.3 (the previous version number 7.3.2 was wrong).
In the Software requirements article, changed the RED OS supported version to 7.3 (the previous version number 7.3.2 was wrong).
In the Software requirements article, changed the RED OS supported version to 7.3 (the previous version number 7.3.2 was wrong).
Added the Issue an access token section to the ADCM API v2 usage examples article.
Added information about access tokens to the ADCM API article.
In the Prerequisites article, added separate instructions for supported operating systems.
In the actions section of the Bundle DSL article, changed the masking attribute description.
Removed the Get started → Online installation section.
In the Software requirements article, added information about support of Ubuntu 22.04.2 LTS.
Added Release notes for the 3.8, 3.9, 3.10, and 3.11 hostprovider versions.
Described the changes that are available starting with the 3.8 hostprovider version:
In the Create hosts with Yandex Cloud hostprovider article, described the Boot disk name field.
In the Create hosts with Yandex Cloud hostprovider article and the Manage a Yandex Cloud hostprovider → Create hosts section, described the name attribute for the Additional disks (JSON) field and updated the example of how to fill this filed.
Added Release notes for the 1.4 hostprovider version.
Reflected changes in the ADB release 6.27.1.58 dated 14.11.2024:
Added Release notes.
In the Software requirements article:
Added information about the RED OS support.
Described minimal versions of ADCM and Yandex hostprovider.
Changed the minimal required version of PostgreSQL from 12.7 to 12.20.
Added information about the Use existing docker option (see point 3).
Updated Java requirements (see point 4):
Changed the required Java version from 11 to 17.
Described specific requirements for CentOS/Astra Linux.
Listed default Java paths for other operating systems.
In the Configure a cluster article:
In the Vault integration section, described the Mount point for ADB cluster secrets field.
Updated descriptions of the Use custom JAVA_HOME for cluster and Use existing docker options.
In the Configuration parameters article, added new sections for the ADB service:
Interconnect properties
ADB ident server
ADB GPperfmon Extension
In the Use ADB DDBoost plugin article, removed the --on-error-continue option from examples.
Actualized ADB known issues.
Reflected changes in the ADB Control release 4.10.3 dated 14.11.2024:
Added Release notes.
Updated all images in the Dashboard article.
In the Monitoring of commands article:
In the Overview section, added the Command error image.
Described possible statuses of plan nodes.
Added the image that shows how the Plan & progress section looks in case of execution errors.
In the LDAP authentication article:
Described the Internal CA certificate in PEM format (optional) field.
Renamed the following fields: URI → LDAP URI, Type → LDAP type.
Changed the LDAP URI description.
Updated the image.
Added information about LDAPS.
For the ADB Control service in the Configuration parameters article:
Described the Use dedicated network section.
Actualized the UI LDAP authentication section.
In the HTTPS parameters enable section, extended the Verify system endpoints' certificates field description.
Added information about the adcc_cluster logical cluster to the following articles:
Configuration parameters (ADB Control → External ADQM parameters)
Actualized SSL encryption.
Actualized ADB Control known issues.
Reflected changes in the ADBM release 2.2.3 dated 14.11.2024:
Added Release notes.
Described the new Workspace section in the Manage configurations in ADBM article.
In the Run actions in ADBM article:
Described the Partial restore action.
Renamed the Restore action to Common restore.
Updated all images.
In the View restores in ADBM article:
Updated all images.
Described the Table-restore restore type.
Described parameters available for the new action Partial restore.
In the Manage configurations in ADBM article:
Updated all images.
In the General configuration section, described the Total number of backups field and extended the Repository path description.
In the Compression section, actualized the default value and removed the 0 value.
In the Run actions in ADBM article:
Added a note with information about availability of the Create restore point action.
Mentioned the Unknown backup status in the Verify action description.
In the View backups in ADBM article:
Updated all images.
Added the Backup statuses schema.
In the View restores in ADBM article, described the Stopped restore status.
In the View actions in ADBM article:
Updated all images.
Renamed the Start time/Start date and End time/End date fields to Start time and End time accordingly.
Actualized the End Results section description.
Actualized ADBM known issues.
Reflected changes in the ADH release 3.3.6.1.b1 dated 30.10.2024:
Added Release notes.
Actualized Supported services and Version compatibility matrix.
Described the Manage Credential Encryption cluster action.
Updated the SSM UI descriptions in the following articles:
Added articles for the SSM service:
Added the SPNEGO authentication in HUE article.
In the Software requirements article, added information about support of Ubuntu 22.04.2 LTS.
For the Hive, Spark, Spark3, and YARN services, described the Add/Remove components service action, which replaced the previously existing separate actions.
For the YARN service, described the Decommiss/Recommiss NodeManagers action.
In the Configuration parameters article:
Described the security.ssl.internal.* parameters and updated the taskmanager* and jobmanager* parameters of Flink.
Updated descriptions of the classpath parameters of Flink, HBase, Hive, Kyuubi, and YARN. Noted that these parameters are represented as lists now, with ability to add elements via the ADCM UI.
Added the Custom log4j.properties section and described the spark.sql.security.confblacklist parameter for Spark and Spark3.
Added the Credential encryption section for HBase, HDFS, Hive, Impala, Solr, Spark, Spark 3, Zeppelin.
Actualized YARN parameters in the mapred-env.sh and yarn-env.sh sections.
Added new SSM parameters.
Actualized other settings for all services.
Added articles for the HBase service:
Added articles for the Airflow service:
Added articles for the Solr service:
In the ADB Spark 3 Connector usage examples article, added examples for PySpark.
In the Use JDBC to connect to Impala article, updated the tab with connection string examples.
In the Configuration groups section of the Configure a cluster article, added configuration details.
Reflected changes in the ADPS release 1.2.0.b1 dated 30.10.2024:
Added Release notes.
Updated Supported services.
Updated the Ranger UI descriptions in all articles.
Described logging settings of the Knox Gateway component in the Knox section of the Configuration parameters article.
Added new articles:
Actualized settings of all services in Configuration parameters.
Reflected changes in the ADCM release 2.4.0 dated 24.10.2024:
Added Release notes.
Added new articles:
In the Installation article, fixed the example of creating a container with environment variables and described new variables:
STATUS_LOG_LEVEL
ADCM_LOG_LEVEL
AUDIT_LOG_LEVEL
LDAP_LOG_LEVEL
BACKGROUND_TASKS_LOG_LEVEL
TASK_RUNNER_LOG_LEVEL
Reflected changes in the ADS Control release 2.3.0.b1 dated 25.10.2024:
Added Release notes.
In the Work with topics in ADS Control article, added the following sections:
Added the Advanced docker settings section to the ADS Control configuration parameters article.
In the Install a cluster article:
Added the Prerequisites section.
Removed the Install OpenJDK and Set service checks parameters.
Reflected changes in the ADPG release 16.3.1 dated 17.10.2024:
Added Release notes.
Added the Upgrade a cluster to a new ADPG version article.
Updated the Switchover from leader to replica in ADPG article:
Added the sudo su - postgres command.
Removed sudo from all subsequent commands.
Replaced /etc/patroni/patroni.yml by /etc/adpg16-patroni/adpg16-patroni.yml.
Removed information about the Run SQL action of the ADPG service.
In the Configure a cluster article, updated the image and described the Ubuntu 22.04 repositories.
In the Requirements article, added information about the Ubuntu 22.04 support and recommended to use ADCM 2.1.2 or higher.
Described defragmentation in the The etcd cluster section of the ADPG high availability overview article.
In all paths, replaced adpg14 by adpg16 and made other necessary updates.
In all links to the PostgreSQL documentation, replaced 14 by 16.
Reflected changes in the ADPG release 14.3.8 dated 17.10.2024:
Added Release notes.
Renamed the Enable maintenance mode and Disable maintenance mode service actions to Pause Cluster and Resume Cluster respectively.
In the Supported extensions article:
Removed the following extensions: hstore_plperl, hstore_plperlu, jsonb_plperl, and jsonb_plperlu.
Updated the version of the timescaledb extension.
Described the following extensions: plperl, plperlu, plpython3u, pltcl, pltclu.
Added a note with information on additional packages for procedural languages.
In the Configure a cluster article, updated the image and described the Cluster UUID parameter (see Primary configuration → General configuration parameters).
Added new articles:
Fixed a misprint on the image in the Load balancing article.
Reflected changes in the ADQM release 24.3.11.7.1.b1 dated 17.10.2024:
Added Release notes.
In the Rolling upgrade article, extended the first note and updated the Abort the upgrade action description.
Added the User-defined functions and Executable tables article.
In the Read Hive data from ADQM article, fixed the test table creation example: back quotes were needed for the date keyword.
Updated the ADCM API v2 usage examples article:
Actualized all parameters.
Changed some examples.
Added highlighting to all code snippets.
Actualized the Backup & Restore article.
Added several recommendations to the first admonition block in the Upgrade article.
In the Work with kafka-rest-security article:
Mentioned out-of-the-box authentication methods that can be configured in a JAAS file and can be used with the kafka-rest-security module.
Described how to enable the mTLS authentication.
In the Configure a cluster article:
Renamed the Timeout to unlock package manager section to Reliability control.
Described the timeout field in the Reliability control section.
Changed default values for the retries and delay fields in the Reliability control section.
In the ADS configuration parameters article, renamed all occurrences of Add key,value to Add key, value.
Reflected changes in the ADS release 3.6.2.1.b1 dated 26.09.2024:
Added Release notes.
Updated version numbers in the list of ADS supported services.
Updated Version compatibility matrix.
Added the Work with kafka-rest-security article.
Updated ADS configuration parameters: relocated server.properties for Kafka.
In the Software requirements article, described requirements for Java.
In the Configure a cluster article, described Custom JDK settings.
Updated the Network requirements article: described ports used in a monitoring cluster and divided the table with all used ports into several tabs — one tab per one product.
Added ADB 7 releases.
Expanded ADB 5 releases.
Moved the ADS Control documentation to a separate repository and made it available via the following link: Arenadata Streaming Control. This link is also located on the ADS landing in the Connected products section (see the Read documentation button).
Actualized ADS Control configuration parameters:
Added the following sections: Kafka Settings and JAAS template file.
Updated the following sections: Kafka Clusters and Basic authentication.
Due to moving the Arenadata Streaming Control (ADS Control) documentation to a separate repository, removed the ADS Control articles from the ADS documentation.
Actualized ADS configuration parameters:
Added template descriptions.
Added the log4j advanced properties configuration group of parameters for the Kafka Broker component of the Kafka service.
Added parameters to the application.conf group of Kafka-Manager.
Added the following parameters: Ranger plugin enabled (for Kafka and NiFi), Set service checks (for NiFi and MiNiFi).
Reflected changes in the ADCM release 2.3.0 dated 05.09.2024:
Added Release notes.
Added the Set up host groups for actions article.
Added the following sections to the ADCM API v2 usage examples article:
Made the following fixes:
In the adcm_hc section of the Ansible modules and plugins article, mentioned components.
In the List services section of the ADCM API v2 usage examples article, replaced the /api/v2/services address by the correct one — /api/v2/clusters.
Added information about RED OS 7.3.2 support to the Prerequisites article.
Added the following articles:
Added a note with information on rolling upgrade to the Cluster actions article.
In the ADB ClickHouse Connector overview article, added the SELECT execution schema diagram.
Reflected changes in the ADB release 6.27.1.57 dated 29.08.2024:
Added Release notes.
In the Configure a cluster article, described parameters of the Vault integration section and updated the last figure.
In the Cluster actions article, updated the first two figures and described the Reconfigure Vault integration action.
Actualized ADB known issues.
Added information about supported Docker version for CentOS to the Software requirements article (see point 3).
Added Accounts in ADB.
Reflected changes in the ADB Control release 4.9.1 dated 29.08.2024:
Added Release notes.
Updated the Dashboard article.
In the Monitoring of sessions article, updated all images and described new table fields: Resource group, Waiting for session, Waiting reason.
In the Work with resource groups article, renamed the Commands section to Commands → Running and added the Commands → Queueing section.
In the Performance section of the Monitoring of commands article, updated images and described the ability to sort and filter data in the table with segment metrics.
Actualized ADB Control known issues.
Reflected changes in the ADBM release 2.1.2 dated 29.08.2024:
Added Release notes.
In the Repository collapsible block of the Manage configurations in ADBM article, updated the figure and described new fields: Upload chunk size and Certificate verification.
In the View backups in ADBM article, described the Statuses section.
In the Run actions in ADBM article, said that the Resume action is now available only fo full backups.
Added new articles:
In the Monitoring article, added the second schema (ADPG monitoring with Metrics storage from the same cluster).
Updated the Work with extensions article.
Added a note about the Backup: Restore cluster action to the Backup: Restore cluster and Backup and restore using pgBackRest articles.
In the Configure a cluster article, updated the last image and added the following sections: Configuration groups and Ansible settings.
In the Add components article, described the Hosts mode, which allows mapping components by hosts.
Instead of all articles in the installation guide related to hostproviders, left only one article Prepare hosts, which contains links to the detailed documentation on each hostprovider.
Added new articles:
In the Configure a cluster article, updated the last image, actualized parameters, and added the following sections: Configuration groups and Ansible settings.
In the Add components article, described the Hosts mode, which allows mapping components by hosts.
Instead of all articles in the installation guide related to hostproviders, left only one article Prepare hosts, which contains links to the detailed documentation on each hostprovider.
In the Cluster actions, described the Manage Kerberos and Manage SSL actions.
Updated the Sqoop overview article.
Added the Use filters in HBase article.
In the Configure a cluster article, updated the last image, actualized parameters, and added the following sections: Configuration groups and Ansible settings.
In the Add components article, described the Hosts mode, which allows mapping components by hosts.
Instead of all articles in the installation guide related to hostproviders, left only one article Prepare hosts, which contains links to the detailed documentation on each hostprovider.
In the Configure a cluster article, updated the last image, actualized parameters, and added the following sections: Configuration groups and Ansible settings.
In the Add components article, described the Hosts mode, which allows mapping components by hosts.
Instead of all articles in the installation guide related to hostproviders, left only one article Prepare hosts, which contains links to the detailed documentation on each hostprovider.
In the Configure a cluster article, added the following sections: Configuration groups and Ansible settings.
In the Add components article, described the Hosts mode, which allows mapping components by hosts.
Instead of all articles in the installation guide related to hostproviders, left only one article Prepare hosts, which contains links to the detailed documentation on each hostprovider.
In the Add components article, described the Hosts mode, which allows mapping components by hosts.
Instead of all articles in the installation guide related to hostproviders, left only one article Prepare hosts, which contains links to the detailed documentation on each hostprovider.
In the Create hosts with Yandex Cloud hostprovider article, added information on products that require FQDNs for hosts created via ADCM.
In the Manage a Yandex Cloud hostprovider article, added information that the Create hosts action is not designed for products that require FQDNs for hosts created via ADCM.
In the Create hosts with SSH hostprovider article, added information on products that require FQDNs for hosts created via ADCM.
In the Create hosts with VCloud (VMware) hostprovider article, added information on products that require FQDNs for hosts created via ADCM.
In the Create hosts with Cloud.ru Advanced hostprovider article, added information on products that require FQDNs for hosts created via ADCM.
In the Manage a Cloud.ru Advanced hostprovider article:
Added information that the Create hosts action is not designed for products that require FQDNs for hosts created via ADCM.
For the Create hosts action, changed the FQDN parameter description.
In the Create hosts with CROC Cloud hostprovider article, added information on products that require FQDNs for hosts created via ADCM.
In the Manage a CROC Cloud hostprovider article:
Added information that the Create hosts action is not designed for products that require FQDNs for hosts created via ADCM.
For the Create hosts action, changed the FQDN parameter description.
Reflected changes in the ADQM release 24.3.2.23.2.b1 dated 02.08.2024:
Added Release notes.
Added information about Ubuntu 22.04 support to Software requirements.
Updated names of parameters in the ADQMDB → LDAP section of the Configuration parameters article and added new parameters name, rbac_scope.
Actualized the LDAP authentication article.
In the Configure a cluster article, changed the structure of parameters description and added the Custom JRE parameter.
Added new articles:
Reflected changes in the ADB release 6.27.1.56:
Added a description of the adb_hba_file_rules_view view to the Work with arenadata_toolkit article.
Added a description of Ubuntu repositories and the Timeout to unlock package manager option to the Configure a cluster article.
Actualized the last image in the Configure services article (caused by changes in the Advanced parameters).
Actualized the first image in the Expand → Run the action section of the Cluster actions article (caused by changes in the Advanced parameters).
Added the KEYSTORE_LOCATION and KEYSTORE_PASSWORD fields to the file that is used in the ADB to Kafka Connector installation article.
In the ADB to Kafka Connector configuration article:
Renamed the JAAS options for the SASL PLAIN mechanism list to JAAS options for the SASL PLAIN, SCRAM-SHA-256, or SCRAM-SHA-512 mechanism.
In the Kafka options list, added new possible values for the following parameters: SECURITY_PROTOCOL — SSL, SASL_MECHANISM — SCRAM-SHA-256 and SCRAM-SHA-512.
Added a file example for SASL_MECHANISM = SCRAM-SHA-256|SCRAM-SHA-512 to the JAAS_CONFIG_FILE section.
In the Use the SERVER option section, added the kafka.property.ssl.keystore.location and kafka.property.ssl.keystore.password options to the kafka-site.xml parameters list.
Added the Custom configuration of the SASL authentication mechanism section.
Added a recommendation about usage of generic cores to the Requirements for Astra Linux section of the Software requirements article.
Updated the ADB known issues article (see the first table row).
Added the ADB → SSL section to the Configuration parameters article.
In the Configure a cluster article, updated the last image and added the following sections: Configuration groups and Ansible settings.
In the Configure ADCM to use an external database article, fixed quote marks for DB_OPTIONS.
Reflected changes in the ADBM release 2.0.4:
Described ADBM CLI.
Described the Use block incremental backup option in the Add a new configuration → General configuration section of the Manage configurations in ADBM article.
Reflected changes in the ADH release 3.2.4.3.b1 dated 23.07.2024:
Added Release notes.
Actualized the Supported services and Version compatibility matrix articles.
Added articles for the HUE service:
Description of HUE ports in the ADH network ports article
HUE service description in the following articles: Add services and ADH architecture
Examples of mapping HUE components in the Add components article
HUE options in the Configuration parameters article
Described work with Iceberg tables:
Added articles on the LDAP authentication:
Added Configure Kerberos authentication based on Samba via ADCM.
Added Ranger Spark3 plugin.
Described the Manage SSL cluster action, which replaced Enable SSL/Disable SSL.
Added articles for the Hive service:
Added articles for the Solr service:
Added articles for the Sqoop service:
Added articles for the MapReduce service:
For YARN, added the Configure and use GPU on YARN article.
In the Configuration parameters article, added a note about filling parameters in the Custom section.
Reflected changes in the ADPS release 1.1.2.b1 dated 23.07.2024:
Added Release notes.
Added the Configure Kerberos authentication based on Samba via ADCM article.
Described the Manage SSL cluster action, which replaced Enable SSL/Disable SSL.
Added Configure Ranger KMS HA.
Added conceptual articles:
In the Configuration parameters article, added a note about filling parameters in the Custom section.
Reflected changes in the ADB Control release 4.8.8:
Described the new role ADBM Administrator in Authorization.
Actualized the Cluster management article since some functionality of the Configuration → Clusters page was moved to a separate form.
Described the relation_statistic table in the Structure of offloaded data section of the Configure job policies article.
Updated a description of the CPU avg usage % metric in the following articles: Monitoring of commands and Monitoring of transactions.
In the Configuration parameters article:
In the ADB Control → External ADQM parameters section, described the ability to use clustered ClickHouse.
In the ADB Control → External ADB Control server parameters section, added the External ADB Control port field and changed the ADB Control address description.
Removed the Listening port field from the ADB Control → HTTPS parameters enable section.
In the Configure external databases for ADB Control and Configure an external database for ADBM articles, divided the first step into two steps, updated queries, added a note about a superuser.
In the Configure security policies, General settings, and Configure job policies articles, updated figures and names of some UI elements.
Reflected changes in the ADS release 3.3.2.2.b1 dated 08.07.2024:
Added Release notes.
Updated versions of NiFi, MiNiFi in the list of ADS supported services.
Updated Version compatibility matrix.
Described the new action Manage SSL (which replaced Enable SSL/Disable SSL) in the following articles:
Actualized the Manage Ranger plugin action description for Kafka and NiFi. Added the Override service policies field description, gave links to related articles in ADPS, updated ADCM screenshots, as well as Ranger screenshots in the following articles:
Added descriptions of the Restart action and the Apply configs from ADCM option for Start and Restart to the Cluster actions article.
Added new articles:
In the Network requirements article, described the 443 port.
Reflected changes in the ADS Control release 2.2.0.b1 dated 27.06.2024:
Reflected changes in the ADCM release 2.2.0 dated 05.07.2024:
Added Release notes.
In the Bundle DSL article, described the flag_autogeneration parameter. Removed allow_flags.
In the Concerns article, extended a description of flags.
Added a description of the pattern property to the config section of the Bundle DSL article.
Described the ability to use SSL when connecting to an external database:
Described the DB_OPTIONS environment variable in the Installation article.
In the Configure ADCM to use an external database article, described parameters available for DB_OPTIONS and added an example how to use them in the JSON format.
In the Configure article, updated the screenshot and removed the Ansible settings section.
Added a note about the ansible.cfg file to the Ansible ecosystem article.
Added information about Ubuntu 22.04 to the Prerequisites article.
Added Ansible inventory structure.
In the following articles, added a note that starting with ADCM 2.0.0 the usage of latest is not supported:
Made the following fixes:
In the Bundle DSL article, replaced bundle_downgrade by bundle_revert.
In the Ansible modules and plugins article:
Updated the example in the adcm_change_flag section.
In the adcm_state section, mentioned components and fixed information about mandatory options.
In the adcm_add_host_to_cluster section, mentioned components.
Added Release notes for the ADB release 6.27.1.56.
Added Release notes for the ADB Control release 4.8.8.
Actualized ADB Control known issues.
Added Release notes for the ADBM release 2.0.4.
Actualized ADBM known issues.
Added new articles:
In the Software requirements article, actualized information about Astra Linux versions supported starting with ADB 6.26.2.55.
Added Release notes for the ADCM release 2.1.2 dated 20.05.2024.
Reflected changes in the ADPG release 14.3.7 dated 13.05.2024:
Added Release notes.
Added new articles:
Description of service actions:
Added the ADPG → Enable backups section to the Configuration parameters article.
Added new articles:
Reflected changes in the ADH release dated 27.04.2024:
Added Release notes: 3.2.4.2.b2, 3.2.4.1.b3.
Added the Custom Java settings article.
Added the Logging in YARN article.
Reflected changes in the ADPS release dated 27.04.2024:
Added the Custom Java settings article.
Added articles for Ranger:
Configuration of an external database to store Ranger metadata:
Reflected changes in the ADQM release 24.3.2.23.1.b1 dated 25.04.2024:
Added Release notes.
Added a description of the bind_dn, User base DN, User search filter, Group base DN, Group search filter parameters to the following articles:
Configuration parameters (ADQMDB → LDAP)
Replaced the Enable Kerberos action by the Manage Kerberos action in texts and images of the following articles:
Described the asynchronous_insert_log parameter in the ADQM log types table of the Logging article and in the ADQMDB → Log settings section of the Configuration parameters article.
Added new articles:
Reflected changes in the ADBM release 1.7.3 dated 11.04.2024:
Created the Configure an external database for ADBM article. Added a link to this article to the Arenadata DB Backup Manager overview and Configure services articles.
Added a descrition of the Verified status to the Manage configurations in ADBM article.
In the Disaster recovery article:
Described the new restore type Streaming.
Removed a description of the manual stream launch.
Described the Backup Manager → Copy → History tab.
Described the Restore points section of a form with deatiled stream information.
Described the Replication lag field, which is available for streams with the Streaming type in the Streaming status on the Backup Manager → Copy → Streams tab and in the window with detailed stream information.
Updated the Terminate action.
Updated all images.
Added the Streaming restore type description to the View restores in ADBM article.
In the Configuration parameters article:
Actualized the ADBM → External database parameters section.
Removed the Database parameters section.
Added a description of the Xmx ram parameter GB parameter to the Database migration parameters section.
Added a note about saving a configuration to the Manage configurations in ADBM article.
Reflected changes in the ADB Control release 4.7.5 dated 11.04.2024:
Created the Configure external databases for ADB Control article. Added a link to this article to the Arenadata DB Control overview and Configure services articles.
Described tagging queries:
Added the Work with query tags article.
Described the Tags column in the following articles: Monitoring of commands, Monitoring of transactions, Monitoring of sessions.
Described the tags field for the query and transaction tables in the Metrics offload → Structure of offloaded data section of the Configure job policies article.
Changed a description of the query plan section in the Monitoring of commands article.
In the Cluster management section, described how to configure GUCs.
Described synchronization of LDAP groups in the Authorization article.
Described how to work with user sessions in ADB Control:
Added the User sessions article.
Described the Manage user sessions permission in the Authorization article.
Described the Session column in the Operations section of the Audit article.
Described the session column for the audit_operation table in the Metrics offload → Structure of offloaded data section of the Configure job policies article.
Described the User session timeout option in the Configure security policies article.
Described the Planchecker service option in the General settings article.
In the View jobs article, updated all images and removed the Status column description from the Jobs → Monitoring → Schedule and Jobs → Backup manager → Schedule tabs.
In the Configuration parameters article:
Actualized the following sections: ADB Control → Database parameters, ADB Control → External database parameters, ADB Control → ADQM database parameters, ADB Control → External ADQM parameters.
Added the Service password description to the ADB Control → UI component parameters section.
In the Metrics offload → Structure of offloaded data section of the Configure job policies article, added a note about choosing DB.
Added a note about upgrade to the Add a cluster section of the Cluster management article.
Reflected changes in the ADB release 6.26.2.55 dated 11.04.2024:
In the Redistribute → Run redistribution section of the Cluster actions article:
Added a description of the Number of parallel processes field.
Updated the screenshot with parameters.
In the Configuration parameters for PXF:
Removed the Force Enable Monitoring option.
Added the Use custom PXF_BASE and PXF_BASE options.
For the JAVA_HOME option, left the default path to Java /usr/lib/jvm/jre-11-openjdk (same for all operating systems).
In the Configure a cluster article:
In the Use custom registry group of options, added the prefix field, updated the registry field.
For the Use custom JAVA_HOME for cluster option, left the default path to Java /usr/lib/jvm/jre-11-openjdk (same for all operating systems).
In the point 4 of the Software requirements article:
Removed Java 8 from supported versions, left only Java 11.
Left the default path to Java /usr/lib/jvm/jre-11-openjdk (same for all operating systems).
Added a description of the tablespace_location field for the db_files_current and db_files_history tables to the Work with arenadata_toolkit article.
Added information about maximum supported version of ClickHouse/ADQM to the Tkhemali Connector 1.X installation article.
Updated the ADPG documentation home page. Instead of the full list of articles (which is still available in the left navigation menu), top 10 popular articles are displayed (based on the statisctics of the past month).
Updated the ADCM documentation home page. Instead of the full list of articles (which is still available in the left navigation menu), top 10 popular articles are displayed (based on the statisctics of the past month).
Updated the ADQM documentation home page. Instead of the full list of articles (which is still available in the left navigation menu), top 10 popular articles are displayed (based on the statisctics of the past month).
Updated the ADS documentation home page. Instead of the full list of articles (which is still available in the left navigation menu), top 10 popular articles are displayed (based on the statisctics of the past month).
Updated the ADH documentation home page. Instead of the full list of articles (which is still available in the left navigation menu), top 10 popular articles are displayed (based on the statisctics of the past month).
Updated the ADPS documentation home page. Instead of the full list of articles (which is still available in the left navigation menu), top 10 popular articles are displayed (based on the statisctics of the past month).
Released the first version of the ADB Cloud Bundle documentation, which includes the following articles:
The documentation link is available in the Hostproviders section on the ADCM landing.
Added Release notes for the ADCM release 2.1.1 dated 11.04.2024.
Reflected changes in the ADS release 3.3.2.1.b1 dated 11.04.2024:
Added Release notes.
Actualized versions in the ADS supported services article.
In the Cluster actions article, described the Manage Kerberos action and removed the Enable Kerberos and Disable Kerberos actions.
Added the Custom kerberization settings article. This article was also mentioned in other Kerberos-related articles.
Added the Configure a custom jaas.conf section to the MIT Kerberos article.
Added the Kafka → JMX auth section to the ADS configuration parameters article.
Added articles:
Added a note about configuration files to the Cluster update section of the Cluster actions article.
In the Install a cluster article, added a note about installation on a clean host with no previous installations of related or similar software.
Added Release notes for the ADB release 6.26.2.55.
Added the Cluster actions article.
Updated ADB known issues (see 6.12.1.11).
Added Release notes for the ADB Control release 4.7.5.
Added Release notes for the ADBM release 1.7.3.
Updated ADBM known issues (see 1.7.0).
Reflected changes in the ADH release 3.2.4.2.b1 dated 27.03.2024:
Added Release notes.
Actualized versions in the Supported services article.
Updated the Version compatibility matrix article.
Described the Smart Storage Manager (SSM) service:
Described the Kyuubi service:
Described the Spark Connect component:
Spark Connect actions (see Add Spark3 Connect and Remove Spark3 Connect)
Spark Connect configuration parameters (see spark.connect.grpc.binding.port)
Added the SSM and Kyuubi services to the Add services article.
In the Add components article, added examples of mapping the SSM and Kyuubi components to hosts.
In the ADH architecture article, actualized the second schema and its description (see SSM and Kyuubi).
Due to the fact that ADQM Spark 3 Connector now comes with the ADH bundle, the connector documentation was moved to the ADH documentation. In articles, small fixes were made related to Spark 3.
In the PySpark article, a path to the Python3 interpreter was changed to /opt/pyspark3-python/.
Information about the Ranger Service Name and Override service policies options was added to the following articles:
Added Enable Kerberos with prepared Active Directory server and no admin permissions.
In the Requirements for SSL certificates article, added a note about using FQDN as a key alias in keystore.jks.
In the Configure Kerberos authentication based on FreeIPA via ADCM article, added information about FQDN usage in the KDC hosts and Kadmin server fields.
Added new articles on Hive:
Added new articles on YARN:
Added a note about configuration files to the Cluster upgrade article.
In the Install a cluster article, added a note about installation on a clean host with no previous installations of related or similar software.
Reflected changes in the ADPS release 1.1.1.b1 dated 27.03.2024:
Added Release notes.
Added the Password encryption article.
In the Knox service management via ADCM article, described the Update Knox passwords action and added a note about the Reload topologies action.
Added information about the Ranger Service Name and Override service policies parameters to the Ranger Knox plugin article.
Added new articles on Ranger:
Extended the Manage roles in Ranger Admin UI article.
Updated the Ranger → LDAP sync source for User synchronizer parameter description in the Configuration parameters article.
In the Configure Kerberos authentication based on FreeIPA via ADCM article, added information about FQDN usage in the KDC hosts and Kadmin server fields.
Added Supported extensions.
In the ADB Control → Database parameters section of the Configuration parameters article, added a note for the Data dir field.
Updated the ADB documentation home page. Instead of the full list of articles (which is still available in the left navigation menu), top 10 popular articles are displayed (based on the statisctics of the past month).
Released the first version of the Yandex Cloud hostprovider documentation, which includes the following articles:
The documentation link is available in the Hostproviders section on the ADCM landing.
Released the first version of the SSH hostprovider documentation, which includes the following articles:
The documentation link is available in the Hostproviders section on the ADCM landing.
Released the first version of the VCloud (VMware) hostprovider documentation, which includes the following articles:
The documentation link is available in the Hostproviders section on the ADCM landing.
Released the first version of the Cloud.ru Advanced hostprovider documentation, which includes the following articles:
The documentation link is available in the Hostproviders section on the ADCM landing.
Released the first version of the CROC Cloud hostprovider documentation, which includes the following articles:
The documentation link is available in the Hostproviders section on the ADCM landing.
Released the first version of the ADQM Cloud Bundle documentation, which includes the following articles:
The documentation link is available in the Hostproviders section on the ADCM landing.
Reflected changes in the ADCM release 2.1.0 dated 20.03.2024:
Added Release notes.
In the Users management article, described user blocks.
Actualized the Enable LDAP article:
Added the third point to the note before the LDAP description section.
Updated the figure.
Described the Group DN for granting ADCM Administrator rights column in the Configuration settings table.
Applied changes to the Ansible inventory groups article:
Described the PROVIDER and HOST groups in the Basic groups section.
All groups were assigned a bundle type (see the last column of tables on the page).
Added the second example to the Examples section.
In the config → Types of configuration parameters section of the Bundle DSL article, actualized the structure description: added a list of available attributes and possible match values, updated the configuration example.
Restructured the Ansible modules and plugins article. Added the adcm_change_flag module description.
Added Concerns.
In the ADCM role model article, made the Permissions and roles table view more convenient.
The Maintenance mode article was moved from the How to section to Concepts.
Reflected changes in the ADPG release 14.3.6 dated 05.03.2024:
Added Release notes.
Added information about support for Astra Linux 1.7 SE "Orel" to the Requirements article.
Described the connection pool management functionality based on PgBouncer:
Added the Configure PgBouncer article.
In the Configuration parameters article, described the Enable PgBouncer section for ADPG.
Described work with PgBouncer in the ADPG architecture overview and Load balancing articles.
Described the PgBouncer statistics dashboard in the ADPG monitoring metrics article.
In the Reconfigure & Restart article, described the Force reconfigure and restart option.
Added the Views and materialized views article.
In the ADPG → Patroni ADPG configurations section of the Configuration parameters article, described the use_custom_location, patroni_log_dir, patroni_log_file_size, patroni_log_file_num, and patroni_log_level parameters.
Added the Integration between ADQM and ADPG article.
In the Service actions, described actions available for Clickhousekeeper.
Information about the need for applying Reconfig and restart to ADQMDB after running Expand/Shrink for Zookeeper/Clickhousekeeper was added to the following articles:
Fixed a description of the Astra Linux SE 1.7 Orel operating system in the Software requirements article.
Added the Use ADB DDBoost plugin article.
Made changes:
In the Software requirements article:
Extended the recommendation for antiviruses.
Described minimal requirements for ClickHouse and PostgreSQL to be used as external databases in ADB Control.
In the Arenadata DB Control overview article:
Recommended to install Chrony.
Described why external databases are recommended for ADB Control in production environments.
Added the Work with arenadata_toolkit article.
In the Network requirements article, gave information about the need for adding ports to an exception list if firewall is used.
Added Release notes for the ADH release 3.2.4.1.b2.
Added new articles on ZooKeeper:
Added the HiveServer2 UI overview article.
In the ADH architecture article, updated the Hadoop ecosystem schema and its description.
Reflected changes in the ADQM release 23.8.2.7.1.b1:
Added Release notes.
Added the Online installation → Install monitoring → Way 1. Monitoring service article, which describes the Monitoring service based on Prometheus. The article was also copied to Offline installation without any changes.
In the Online installation → Install monitoring and Offline installation → Install monitoring, described two ways to install ADQM monitoring — via the new monitoring service or the monitoring cluster (Enterprise Tools cluster in case of offline installation). Added information that the second way (via a separate cluster) is deprecated.
Since creation of the cache over local disks is no longer supported, actualized the Configure data storages article.
In the Service actions article, described the Disable validation option for the ADQMDB service action Reconfig and restart.
Made changes in the Configuration parameters article for the ADQMDB service:
Added the Enable secure intra-cluster communication parameter to the Intra-cluster communication security section.
Updated descriptions of parameters in the Cache section (ex. Local cache).
In the JDBC Bridge configuration section, described jdbc bridge log path.
Removed the Specify a directory to store ZooKeeper log files article since in the new ADQM release the described actions are not needed. The article is still available for the previous ADQM versions.
Added the Integration between ADQM and Kafka article.
Reflected changes in the ADB release 6.26.0.53:
Added Release notes.
In the Software requirements article, added specific requirements for Astra Linux related to cgroups v1.
In the Configure services article, updated the last figure since the PL/Python3u Extension parameter was added.
In the Configuration parameters article, described the PL/Python3u Extension parameter (see the Main section). Also, the Use nobarrier parameter was described (for master and segments separately).
Described two ways of integration between ADB and Kafka:
ADB to Kafka Connector:
Kafka to ADB Connector:
In the Configure a cluster article, recommended to use Java 11 in case of custom installation. The same note was added to Software requirements.
In the Network requirements article, added information about ports used by ADB to ADB Connector.
Updated ADB known issues.
Reflected changes in the ADB Control release 4.6.4:
Added Release notes.
Renamed the Metrics chart article to Dashboard and moved it to the lower level. All images in the article were updated.
In the SSL encryption article, updated images, actualized parameters in the HTTPS parameters enable section, and added some notes. Also, added new parameters to the Configuration parameters article (see ADB Control → HTTPS parameters).
At the beginning of the Cluster management article, added a note about the need for upgrading external ADB cluster in case of using ADB Control starting with 4.6.4.
In the Monitoring of sessions article, updated all images due to adding the Application name column and some fixes of the light theme in UI. The Application name description was added to the table.
In the Configure role mappings with LDAP groups section of the Authorization article, updated all images due to adding buttons and filters above the table in UI.
In the Metrics offload → Configuration section of the Configure job policies article, updated all images where the Export sessions flag is displayed.
In the Metrics offload → Structure of offloaded data section of the Configure job policies article, updated the offload condition for the session table due to adding the Export sessions flag.
In the Basic authentication article, updated all images since block and unblock icons replaced each other.
Updated ADB known issues.
Reflected changes in the ADBM release 1.6.3:
Added Release notes.
Added the Draft configurations section to the Manage configurations in ADBM article, which describes the new backup status Draft. In the Add a new configuration section, replaced the Creating status by Draft.
In the View backups in ADBM article, described the Unknown status.
In all articles where ADCM web interface is mentioned, updated all texts and figures according to ADCM 2.0.0:
Online installation (with subsections)
Offline installation (with subsections)
Service actions (with subsections)
Reflected changes in the ADH release 3.2.4.1.b1:
Added Release notes.
Updated versions in the Supported services article.
Actualized Hive configuration parameters: removed the External database section, added the javax.jdo.option.ConnectionDriverName parameter to the hive-site.xml section, added the default value for the javax.jdo.option.ConnectionURL parameter.
Actualized HDFS configuration parameters: renamed the HDFS heap memory settings section to Hadoop options and updated names and descriptions of its parameters.
Updated screenshots of the Airflow 2 web interface in the Airflow UI overview article.
In the Software requirements article, added information about support for Astra Linux 1.7 "Orel" SE with Axiom JDK (with the need for LC_TIME=en_US.utf8), fixed requirements for package managers, and gave a link to Version compatibility matrix.
In the description of YARN configuration parameters, said about the need to set min.user.id for correct YARN operation under Astra Linux (see container-executor.cfg).
Added new articles:
In the Use impala-shell to connect to Impala article, described how to fix the ImportError: no module named pkg_resources error.
Reflected changes in the ADPS release 1.1.0.b1:
Added Release notes.
Updated versions in the Supported services article.
In the Software requirements article, added information about support for Astra Linux 1.7 "Orel" SE with Axiom JDK (with the need for LC_TIME=en_US.utf8).
Actualized Ranger configuration parameters: removed the External database section, added the ranger.ks.jpa.jdbc.driver parameter to the dbks-site.xml section.
Added new articles:
The Ranger audit description was updated and moved from the ADH/ADS documentation to the ADPS article Ranger audit.
In the Enable SSL on ADPS cluster with Knox article, described how to clear the gateway.tls.key.alias value in ADCM 2.0.0.
In all articles where ADCM web interface is mentioned, updated all texts and figures according to ADCM 2.0.0:
Online installation (with subsections)
Offline installation (with subsections)
Added Release notes for the ADCM release 2.0.0.
In the Installation article, described environment variables (that can be optionally defined when a container is created) and recommended to use PostgreSQL in production.
In the Set the ADCM URL section of the Installation article, updated information about setting ADCM URL.
Updated the ADCM API v2 usage examples article: changed parameters and updated response examples for some queries.
Added the ADCM Auditor role description to the ADCM role model article.
In the Users management article, described how to unblock users.
Added information about the system and status users to the Audit UI article.
In the ADCM API article, gave a link to the API v2 specification and added information that API v1 is deprecated.
In the following articles, described the new versioning format, which is used starting with ADCM 2.0.0:
In the Upgrade article, recommended to backup ADCM data before upgrade.
Restructured the Release notes article: all releases are now located at the top level.
In all articles where ADCM web interface is mentioned, updated all texts and figures according to ADCM 2.0.0:
Added the Kafka API usage example article.
In all articles where ADCM web interface is mentioned, updated all texts and figures according to ADCM 2.0.0:
Online installation (with subsections)
Offline installation (with subsections)
Service actions (with subsections)
Added new articles:
In the Enable SSL/Disable SSL article, described the need to restart Solr if the Ranger Solr plugin is enabled.
In all articles where ADCM web interface is mentioned, updated all texts and figures according to ADCM 2.0.0:
Online installation (with subsections)
Offline installation (with subsections)
Enable Kerberos with prepared FreeIPA server and no admin permissions
Ranger plugins for ADH (with subsections)
Added new articles:
In all articles where ADCM web interface is mentioned, updated all texts and figures according to ADCM 2.0.0:
Online installation (with subsections)
Offline installation (with subsections)
In the Software requirements article, recommended to switch off any antivirus software before ADB installation and during the ADB operation process (see point 6).
In all articles where ADCM web interface is mentioned, updated all texts and figures according to ADCM 2.0.0:
Online installation (with subsections)
Offline installation (with subsections)
In all articles where ADCM web interface is mentioned, updated all texts and figures according to ADCM 2.0.0:
Added Release notes for the ADH release 3.1.2.1.b2.
Added Release notes for the ADPS release 1.0.5.b2.
Added Release notes for the ADCM release 2023.11.28.07.
Added new articles on Hive:
Added new article on HDFS:
Updated a description of Ranger plugins:
Actualized the articles:
Added the articles:
Added the Ranger Knox plugin article.
Reflected changes in the ADB Control release 4.5.3:
Added Release notes.
Described monitoring of ADB sessions:
Added the Monitoring of sessions article.
In the Configure job policies article, described the session table and conditions for offloading its data. Updated images (as the UI page now displays information about the need to select a database for data offloading).
In the General settings article, described the Sessions tab.
In the Authorization article, described the View sessions permission.
In the Arenadata DB Control overview article, mentioned monitoring of sessions as the ADB Control feature.
In the Audit article, described the session object type.
In the Cluster management article, removed information about adding a cluster manually; moved a description of cluster settings to the section that describes how to edit a cluster; updated all images (since the Create connection button was removed).
In the ADB Control section of the View jobs article, updated images since ADCC was replaced by Monitoring in breadcrumbs.
Updated figures in most articles where the light theme of the ADB Control UI was displayed.
Reflected changes in the ADBM release 1.5.2:
Added Release notes.
In the Run actions in ADBM article, updated the Restore action description:
Changed the Skip validation flag description.
Added information about the Restore mirrors list.
Updated figures.
In the View actions in ADBM article, added the Warning status to the list of action statuses. Added descriptions for all action statuses.
In the Hardware requirements article, changed requirements for ADB hosts during ADBM installation.
Reflected changes in the ADB release 6.25.2.52:
Added Release notes.
Added the following information to the Software requirements article:
Information about Astra Linux 1.7 "Orel" SE support.
Information about Docker support.
Java supported versions.
Requirement for the en_US.utf8 locale.
In the Configure a cluster article, described new parameters:
In the ADB to ADB Connector overview article, extended the third point of the first note — about usage of INSERT.
In the Add hosts article, updated the second note — about the ability to use FQDN in host names.
In the Configuration parameters article, extended a description of the JAVA_HOME parameter for PXF (described system default paths).
Updated ADB known issues.
Moved the ADPS documentation to a separate repository and made it available via the following link: Arenadata Platform Security. This link is also located on the ADH and ADS landings in the Connected products → Arenadata Platform Security section (see the Read documentation button).
Moved the following ADPS articles from the ADH and ADS documentation (with updates):
Get started with Arenadata Platform Security (with subsections)
Planning guide:
Added new articles:
Actions available for ADPS clusters via ADCM:
Actions available for ADPS services via ADCM:
Due to moving the Arenadata Platform Security (ADPS) documentation to a separate repository, made the following changes:
In the section related to authorization in ADH, left only one ADPS overview article — Arenadata Platform Security overview. This article contains links to the ADPS documentation.
Removed other articles that were added to the ADPS documentation.
Added new articles:
In the Filesystem requirements article, described the umask option (user file-creation mode mask).
Due to moving the Arenadata Platform Security (ADPS) documentation to a separate repository, made the following changes:
In the section related to authorization in ADS, left only one ADPS overview article — Arenadata Platform Security overview. This article contains links to the ADPS documentation.
Removed other articles that were added to the ADPS documentation.
Reflected changes in the ADH release 3.1.2.1.b1:
Added Release notes.
Updated service versions in the Supported services article.
Added articles on Impala:
Described the new service component — Flink SQL Gateway.
Described the Manage Kerberos cluster action.
Updated the AD Kerberos common problems article. Described the error related to creating an HTTP principal on a host in AD domain.
Added the Remove a host from a cluster article, which explains how to use a maintenance mode in ADH.
Described how to work with PySpark.
Updated the High availability in Hive article due to the high availability (HA) optimization for Hive.
In the Flink overview article, mentioned the automatic HA activation.
Updated the Flink UI description in the Flink UI overview article.
Due to the fact that ADB Spark 3 Connector now comes with the ADH bundle, the connector documentation was moved to the ADH documentation. The ADB Spark 3 Connector usage examples article was completely rewritten: prerequisites were described, all commands were divided into two parts (command and output). In other articles, small fixes were made related to Spark 3.
In the Cluster upgrade article, fixed a description of the bundle naming scheme.
Added new articles on Spark:
Added the Use JDBC to connect to Hive article.
Added new articles on HDFS:
Basic operations:
Data storage management:
Described actions available for ADH clusters via ADCM:
Described actions available for ADH services via ADCM:
Added Filesystem requirements.
Updated a description of the dfs.internal.nameservices HDFS configuration parameter in the Configuration parameters article.
Added Release notes for the ADPS release 1.0.5.b1.
Reflected changes in the ADS release 2.8.1.1.b1:
Added Release notes.
Updated service versions in the Supported services article.
Added the Encryption of NiFi configuration parameters article.
Updated service parameters in the ADS configuration parameters article.
Added RedOS to the list of supported operating systems.
Added examples how to use ADS services:
Described ZooKeeper concepts:
Added some references:
In the SSL channel security article, added a note about the need to fill in san when creating certificates. Updated the generate.sh script, which is used to create self-signed certificates (considering san).
Added Release notes for the ADCM release 2023.10.10.08.
In the Metrics offload section of the Configure job policies article, added a subsection with a structure of offloaded tables and conditions for their offloading.
Added the General settings article, which describes how to configure Time zone. This functionality is available starting with ADB Control 4.4.0.
Updated all articles according to the current version of ADB Control (4.4.0):
Updated all screenshots due to changes in the left navigation menu and adding a timezone in the top right corner of ADB Control UI. The light theme of the documentation now shows screenshots corresponding to the light theme of the application.
Updated a description of table filters in the following articles:
Applied changes to the following articles:
Described the Export resource groups, Interval, and Delay fields.
Divided the process of configuring a JDBC connection into two steps: JDBC URL and user/password.
Renamed ADCC tabs to ADB Control.
Renamed the Time (on the Operations tab) and Event time (on the Authorizations tab) fields to Operation time.
Described the ADB LDAP authorization type for the Authorizations tab.
Described the System settings object type for the Operations tab.
Described the ability to view changed parameters on the Operations tab.
View information on components:
Renamed ADCC tabs to ADB Control tabs.
Excluded Monitoring before Information from paths that are used on the page.
Renamed the User field to Username.
Renamed the Set default cluster button to Set default.
Connect to ADB Control: renamed the Login field to Username.
View jobs: removed the Error message column description from the both Audit tabs since its functionality was moved to the Job name column.
Updated all articles according to the current version of ADBM (1.4.0):
Updated all screenshots due to changes in the left navigation menu and adding a timezone in the top right corner of ADBM UI. The light theme of the documentation now shows screenshots corresponding to the light theme of the application.
Updated a description of table filters in the following articles:
Applied changes to the following articles:
Added the cifs repository type to the Add a new configuration section of the Manage configurations in ADBM article.
Described the Autostart, Backup type options and a note related to them in the Disaster recovery article (see step 6 in the Configure and run section).
Described the Action ID field in the Subaction details table of the View actions in ADBM article.
In the Fields of the Overview section table of the View restores in ADBM article, described the ability to head to the backup configuration details via a link. Changed the order of the Databases and Restore types columns.
Removed the third limitation from the Overview section of the Manage configurations in ADBM article.
In the Concepts → WAL section of the Arenadata DB Backup Manager overview article, changed the incorrect size of WAL segments from 16 MB to 64 MB.
In the ADB ClickHouse Connector usage examples article, described how to select data from ADQM/ClickHouse to ADB.
At the beginning of the Maintenance mode article, added a note about availability conditions of this mode.
In the Prerequisites article, fixed a description of minimal requirements.
Added Release notes for the ADCM release 2023.09.28.17.
Added articles:
Upload a bundle to ADCM (with a description of the bundle signature verification)
Changed the following articles:
In the Configure article, updated the image and added the Data retention policy and Statistics collection sections.
Updated the ADCM role model, Configure user permissions, Create policies articles since the role model is now based on groups instead of users.
In the UI overview article, updated the BUNDLES tab description: updated the image, described the Signature attribute.
Reflected changes in the ADB release 6.25.1.51:
Added Release notes.
Described the ADB to ADB Connector:
Described requirements for ADB installation:
Updated ADB known issues.
Added Release notes for the ADB Control release 4.4.0.
Updated ADB Control known issues.
Added Release notes for the ADBM release 1.4.0.
Added Release notes for the ADB Control release 4.3.3.
Added new articles:
In the Audit article, added the Relation audit details section.
In the table that describes access permissions in ADB Control, added links to the documentation sections where users can find details of the corresponding operations.
Divided the Add a cluster section in the Cluster management article into two parts: automatically and manually. Added notes at the beginning of each section.
Reflected changes in the ADBM release 1.3.3:
Added Release notes.
Updated the Disaster recovery article:
Described the Restore mirrors flag.
Updated the image that describes the Stream Info UI window.
Updated the ADBM known issues article. Closed problems that were fixed in ADBM 1.3.3.
At the beginning of the Manage configurations in ADBM article, added a note about the need to create a new configuration when switching to standby master.
Added Release notes for the ADB release 6.25.1.49.
Updated the ADB known issues article.
Reflected changes in the ADS Control release 2.1.1.b1:
Replaced the Arenadata Streaming Command Center (ADSCC) name by Arenadata Streaming Control (ADS Control) in all texts.
In the UI overview article, updated the section related to cluster management: described filters and legend.
In the ADS Control overview article, described user management in a separate section.
In the following articles, updated images for both themes and added icons:
Added Release notes.
Released the first version of the updated ADQM Spark Connector documentation, which includes the following articles:
In comparison with the previous version:
Updated existing articles according to the internal style guides.
Added the ability to select a version like for other products (via the Select version drop-down list in the left).
Extended the Usage example article.
Added the documentation link to the ADH and ADQM landings.
Added the ability to select a language like for other products (via the toggle in the top right corner). Translated existing article into Russian. All new articles will be published in two languages simultaneously.
Added the ability to select a version like for other products (via the Select version drop-down list in the left).
Updated existing articles according to the internal style guides.
Reflected changes in the ADQM release 23.3.2.37.1.b1:
Added Release notes.
Added the Configure data storages article with a detailed description of available storage types.
Updated configuration parameters for the ADQMDB service:
Instead of the Storage Configuration parameter, added new sections: Enable additional local storage, Enable S3 storage, Enable local cache, Enable encrypted storage, and Storage policies.
Added the following parameters to the User password options section: Allow Implicit_NO_password, Length of password, Include Upper-case, Include Lower-case, Include Number, Include special symbols.
Added the Encryption codecs for tables section.
Added the Configure logical clusters in the ADCM interface article.
In the table of the Network requirements article, added the 9010 port for ClickHouse and the 9444, 9281 ports for ClickHouse Keeper.
Reflected changes in the ADBM release 1.3.2:
Added Release notes.
Updated the Disaster recovery article:
Updated figures according to changes in tables and filters.
Described filters available for the table with configurations.
Changed a description of filters available for the table with a list of streams.
In the table that describes the Overview section (stream details), added the Restore type field.
In the Create stream → Stream Info form description, removed the Restore mirrors flag and the note about restrictions.
Updated the ADBM known issues article. Closed problems that were fixed in ADBM 1.3.2.
Added Release notes for the ADB Control release 4.3.2.
Added ADB Control known issues.
Added Release notes for the ADB release 6.24.3.48.
Added ADB known issues.
Released the first version of the ADB Control documentation, which includes the following articles:
Reflected changes in the ADBM release 1.3.0:
Added the Disaster recovery article.
In the Manage configurations in ADBM article, updated figures and descriptions/default values of parameters. For the Full Backup schedule, Differential backup schedule, Incremental backup schedule, Restore point creation schedule, and Cleanup schedule options from the General configuration section, described switches, which define whether to perform actions manually or on schedule. Rules for parameters that specify time and data amount values were moved from tables to one place before information on adding a configuration.
Updated the Run actions in ADBM article:
In the View backups in ADBM article, updated images and filters. Added the Delta flag description to the backup details.
In the View restores in ADBM article, updated images, described the Restore type field (with possible values Self-restore and Copy). In the section with detailed restore information, described the Processes, Restore type, Action parameters; updated the Flags field.
Reflected changes in the ADB release 6.24.3.47:
Updated the ADB ClickHouse Connector installation article. There is no more need to load packages manually.
At the beginning of the Tkhemali Connector 1.X installation article, added a note about the connector status.
In all articles of the ADB installation guide, updated images and names of services/components due to renaming ADCC to ADB Control and Tkhemali to ADB ClickHouse Connector.
In the Configuration parameters article, updated names of the ADB Control parameters.
Reflected changes in the ADS release 1.8.2.b1:
Added Release notes.
Added information about the Astra Linux support to Software requirements.
Updated a description of the Basic and SASL PLAINTEXT authentication:
In the Configure a cluster article, added a block with images that explain how to configure different types of authentication (as well as for offline).
In the Basic authentication and SASL PLAINTEXT articles, updated a description of the authentication configuration and user management.
In the Use SASL PLAINTEXT in Kafka article, updated a description of user management.
In the Cluster actions article, removed a description of actions related to the Basic and SASL PLAIN authentication.
Replaced SASL PLAIN by SASL PLAINTEXT in all texts.
Added new articles on NiFi:
Described configuration best practices for Kafka and NiFi:
Added the KsqlDB usage example article.
Added the Kafka REST Proxy usage example article.
Added Release notes for the ADCM release 2023.07.10.17.
Extended the Bundle DSL article. Added a description of the optional parameter requires.
Updated the Configure article. Changed the structure of parameters and described settings for authentication policies (to counteract brute-forcing methods).
Added examples of using the APT manager (in addition to YUM) to the Prerequisites article.
In the Users management article, described the ability to reset the login attempts counters of other users.
Added the Integration with the bundle article, which contains sequence diagrams for bundle load and action launch.
Removed incorrect quotes from examples in the Configure ADCM to use an external database article.
Reflected changes in the ADPG release 14.3.4:
Explained changes in the monitoring system.
Updated the monitoring installation guide: online and offline.
Updated a description of monitoring metrics available for the ADPG cluster.
Added Release notes.
Added new articles on the ADPG data model:
Added new articles with data query examples to the How to → Data querying section:
Described Kerberos authentication:
Described the Enable Kerberos, Disable Kerberos, and Reconfig Kerberos actions in the Manage a cluster section of the article that describes ADQM cluster actions.
Described the purpose and usage details of the following coordination services:
Added the Work with Livy article.
Extended the planning guide:
Added the PostgreSQL nodes used with Hive Metastore article.
Described how to add HDFS data directories.
Updated the ADH installation guide:
Actualized images and service descriptions in all articles.
Updated a description of parameters in the Configure a cluster article.
Added Release notes:
Reflected changes in the ADH release 2.1.10.b1:
Added Release notes.
Updated Supported services.
Added the Set TLS version for an ADH cluster article.
Updated the YARN high availability overview article. Added information about the automatic HA activation.
Added the User-managed interpreters article.
Described monitoring metrics available for ADH services.
Added Release notes for the ADPS release 1.0.4.5.
Added Release notes for the ADCM release 2023.06.14.16.
Added the Bundle DSL article.
Updated the Ansible modules and plugins article. Described adcm_change_maintenance_mode.
Added the Ansible inventory groups article.
Added Release notes for the new ADB releases: 6.23.5.45 and 5.29.11.19.
Renamed the new ADQM/ClickHouse connector from Tkhemali connector 2.0 to ADB ClickHouse Connector in the following articles:
In documentation on the previous connector version Tkhemali 1.X, replaced the Tkh profile name by TKH. The profile name should be written in uppercase.
Added Release notes for one of the previous ADB Control versions — 3.1.3.
Updated configuration parameters according to the ADQM release 22.8.12.45:
In the SSL section, described the Enable https, Enable tcp secure parameters.
In the Engine section, described possible values of the System parameter.
Renamed the Clickhouse Keeper section to Clickhouse Keeper (integrated). Added the Enable IPv6 parameter to this section.
In the Limits section, changed the Max concurrent threads parameter description, added the Max server memory usage, Max thread pool size parameters.
In the Network section, described the Enable http, Enable tcp, ClickHouse tcp port parameters.
In the Intra-cluster communication security section, added the Interserver protocol, Interserver protocol’s port parameters.
Added the Kerberos configuration section.
In the Log settings section, described the Logging level, Log file size, MB, Log files count, metric_log, asynchronous_metric_log parameters.
Added the User password options section.
Added the Data compression section.
In the Other section, described the Time zone parameter.
Renamed the Server configuration section to Network configuration. Added new parameters to this section.
Added the Proxy wildcarded users section.
Described the Clickhousekeeper parameters.
Updated descriptions of the parameters in the Proxying and Enable SSL encryption articles.
In the Add services article, added the Clickhousekeeper service to the table with ADQM services.
Reflected changes in the ADB release 6.23.3.44 dated 27.04.2023:
Described the new ADQM/ClickHouse connector — Tkhemali connector 2.0:
In all articles, renamed Arenadata DB Command Center (ADBCC) to Arenadata DB Control (ADB Control).
Added Release notes:
Added information on the previos connector version Tkhemali 1.X. You can use the new connector version in the beta mode simultaneously with the previous version. In comparison with old documentation, the new Tkhemali 1.X documentaion was actualized, populated with examples, and divided into three sections:
Reflected changes in the ADBM release 1.2.1 dated 27.04.2023:
Described the Restores tab, which allows users to view Restore actions.
In the Connect to ADBM article, added information about the need to change the admin password when a user first logs in.
On all figures, replaced Arenadata DB Command Center (ADBCC) by Arenadata DB Control (ADB Control).
Added Release notes.
Added a note about limitations for adding a configuration. See the CAUTION block before the Add a new configuration section in the Manage configurations in ADBM article.
Reflected changes in the ADQM release 22.8.12.45:
Added Release notes.
Added information about Astra Linux support to the Software requirements article.
Added new articles to How to → Data querying → Query types:
In the Add components section, added information that when installing Clickhouse JDBC Bridge (optionally), a user should install it on all hosts with the Clickhouse Server component.
Added Release notes for the ADCM release 2023.04.21.12.
Removed extra ALTER USER command from the Configure ADCM to use an external database article.
Added Release notes.
Added Supported services.
Updated the Supported services article.
Added the AD Kerberos common problems article (with a description of ways to resolve them).
Fixed a typo with the Solr name on the second figure in the ADH architecture article.
Reflected changes in the ADS release 1.8.1.b1:
In the Schema-Registry actions article, described new actions Expand and Shrink for Schema-Registry.
Described how to configure MiNiFi for a group of hosts: Configure services → Configuration groups.
Described how to configure Log4j logging at the level of service components: Configure services → Components.
In all articles, renamed KSQL to ksqlDB.
Updated Kafka Connect and ZooKeeper versions in the Supported services article.
Added Release notes.
In the ADS configuration parameters article, added the Basic Auth properties group of parameters for ksqlDB, Kafka REST Proxy, Schema-Registry and the MiNiFi Agent bootstrap.conf group of parameters for MiNiFi.
Added new articles on NiFi:
Added Release notes for the ADCM release 2023.04.10.22.
Released the first version of the ADB documentation, which includes the following articles:
ADB installation guide (via ADCM):
Online installation (with subsections)
Offline installation (with subsections)
Articles on the ADB data model:
Description of work with tables:
Overview of server configuration parameters (Global User Configuration, GUC): Configure via GUC.
Overview of ADB parameters that can be configured via ADCM: Configuration parameters.
Release notes divided by services:
Released the first version of the ADBM documentation, which includes the following articles:
Overview of the ADBM features, architecture, and main concepts: Arenadata DB Backup Manager overview.
Description of connecting to ADBM via web interface: Connect to ADBM.
Overview of configurations that are used to launch backups and other actions: Manage configurations in ADBM.
Description of cluster actions: Run actions in ADBM.
How to view backups and their details: View backups in ADBM.
How to view actions and their details: View actions in ADBM.
Reflected changes in the ADCM release 2023.03.27.20:
Described how to use PostgreSQL: Configure ADCM to use an external database.
Described migration from SQLite to PostgreSQL: ADCM migration.
Added Release notes.
Added the Ansible modules and plugins article.
Added the Import/export of services article.
Described how to view ADCM API.
Added author names to all articles.
Reflected changes in the ADPG release 14.3.3 dated 16.03.2023:
Described load balancing based on HAProxy, which is available in the Enterprise edition of ADPG: Load balancing, Configure load balancing.
In the Add services and Add components articles of the ADPG installation guide, described the Balancer service.
Updated the section that describes ADPG cluster and service actions: ADPG cluster management. Marked actions available for Balancer; removed actions that were previously used to install the contrib and PostGIS extensions (currently preinstalled in ADPG).
Updated the Work with extensions article.
In the Configuration parameters article, described the Balancer parameters and removed the options that were used to install extensions.
Added Release notes.
Added the Logical replication article.
Added the Use cases article.
Added articles related to the ADPG data model:
Updated and populated with usage examples the following articles:
Updated and added examples to the Use tables and column aliases in queries article.
Removed the following articles:
Concepts → About — this article was replaced by Use cases.
References → SQL — all useful commands with detailed examples will be added to How to and Concepts.
References → PostgreSQL cheatsheet — useful psql commands were moved to the Use the standard PostgreSQL tool — psql to connect to ADPG article.
Added author names to all articles.
Released the first version of the ADQM documentation, which includes the following articles:
ADQM planning guide:
ADQM installation guide (via ADCM):
Online installation (with subsections)
Offline installation (with subsections)
Specific features of ADQM as a database.
ADQM architecture:
ADQM data model:
Possible connection ways:
Authentication ways:
Authorization based on the RBAC model.
Actions available for ADQM at the cluster and service levels via ADCM:
Added Release notes for the ADH release 2.1.8.b3.
Added the Cluster upgrade article, which describes the minor/major upgrade principles.
Added articles on FreeIPA:
Translated and fixed articles from the Hadoop Command-line section (with subsections)
Added author names to all articles.
Fixed the following:
In the Software requirements article, added information about support for AltLinux 8 SP and minimal versions of Java and ADCM.
In the ADH architecture article, changed a caption for the second image.
On the product home page, removed the user level selector (due to the insufficient number of articles for such division).
Reflected changes in the ADS release 1.8.0.b1 dated 02.02.2023:
In the Service actions article described the ability to remove ADS services from a cluster.
Updated service versions in the Supported services article.
Added Release notes.
Described NiFi authorization:
Extended the Cluster actions article. Described actions that become available after running other actions (Create/Update/Delete user, Manage Basic Auth users, and several Disable actions).
Restructured articles related to authorization:
Moved the common part (related to the authorization and audit via ADPS) from How to → Kafka → Access management → Authorization → ADPS to Tutorials → Access management → Authorization → ADPS. This part includes the following articles:
In the How to → Kafka → Access management → Authorization and How to → NiFi → Access management → Authorization sections, left descriptions that are specific for the Kafka and NiFi services accordingly. Linked these descriptions with common articles mentioned above.
Fixed the following:
Corrected the Shrink description for the MiNiFi service (in the DN description).
In the Mirror Maker 2 article, fixed an error with the /bin duplicate in one of the paths used.
Added the NiFi Server UI overview and NiFi Registry UI overview articles.
Added the NiFi service authentication article.
Reflected changes in the ADS release 1.7.2.b2 dated 10.01.2023:
Added the Basic authentication article, which describes basic authentication for the Schema Registry, Kafka REST Proxy, KSQL services.
Added Release notes.
Restructured articles related to authentication:
Moved the common part (related to the authentcation configuration via ADCM) from How to → Kafka → Access management → Authentication to Tutorials → Access management → Authentication. This part includes the following articles:
In the How to → Kafka → Access management → Authentication and How to → NiFi → Access management → Authentication sections, left descriptions that are specific for the Kafka and NiFi services accordingly. Linked these descriptions with common articles mentioned above.
Added author names to all articles.
Added Release notes for the ADSCC release 1.0.0.b2 dated 10.01.2023.
Added author names to all articles.
Added the ability to select a language like for other products (via the toggle in the top right corner). Translated existing article into Russian. All new articles will be published in two languages simultaneously.
Added the ability to select a version like for other products (via the Select version drop-down list in the left).
Updated existing articles according to the internal style guides, fixed some articles based on the technical review.
Restructured the left navigation menu (TOC) and the product home page:
Expanded article titles so that users could clearly understand what services they work with when navigating from the search results. Removed duplicate titles, such as Example, How it works, etc.
Standardized names of articles in the left menu, on the home page, in article titles, and in cross links.
On the product home page, extended a number of articles for quick access. The sections are named according to other products.
In the left navigation menu, moved all articles related to concepts (architectural schemas, work principles) from How to to Concepts.
Added intermediate sections to the How to guide. Previously, all articles were located at the top level.
In the Concepts section of the left menu, stopped to divide ADH services into core and other. All services are located at the top level like in How to. All architectural schemas were moved to ADH architecture.
Added new materials:
In the Release notes article, described all ADH releases starting with 2.1.7.b1.
Added the High availability in Hive article.
In the Solr collections article, updated commands that are used to work with Solr collections. Described two ways to run commands: via the /usr/lib/solr/bin/solr script and the solrctl utility.
Moved configuration parameters of all ADH services to a single article Configuration parameters like in other products. Added parameters implemented in the latest ADH releases.
Reflected changes in the ADPG release 14.3.2 dated 29.12.2022:
Described the high availability (HA) mode based on Patroni for the Enterprise edition of ADPG: ADPG high availability overview.
Described offline installation of ADPG, which is available in the Enterprise edition of ADPG: Offline installation (with subsections).
Described new service actions: Enable maintenance mode, Disable maintenance mode, Expand.
In the ADPG installation guide, updated the articles that describe how to add services, map components, and install a cluster: described the Etcd service, updated the example of mapping components, updated final service statuses.
In the ADPG installation guide, updated articles related to monitoring (online, offline): removed the Monitoring Clients service; described the Enable monitoring option and the Install monitoring agents cluster action. The updated guide on the monitoring configuration is available in the following articles: online, offline.
Updated the architectural schema in the ADPG architecture article. On the schema, new components related to HA were highlighted.
Updated options in the Configuration parameters article. Added parameters related to HA (see ADPG → Patroni ADPG configurations).
Added Release notes.
Added new articles related to data backups:
Removed the How to → Working with actions article. Instead of it, added new articles:
Cluster actions — description of actions available at the cluster level.
Service actions — with subsections that describe service actions (one action per one page).
Added Release notes for the ADCM release 2022.12.26.18 dated 26.12.2022.
Released the first version of the Arenadata Streaming Command Center (ADSCC) documentation, which describes the ADSCC release 1.0.0.b1 dated 23.12.2022:
Reflected changes in the ADS release 1.7.2.b1 dated 06.12.2022:
In the ADS configuration parameters article, described new parameters available for ADS services via ADCM UI.
Added Release notes.
Added new articles:
Reflected changes in the ADCM release 2022.12.07.10 dated 07.12.2022:
Added the Audit UI article, which describes two new tabs in the ADCM interface (Audit operations and Audit logins).
Moved the Maintenance mode article from Concepts → ADCM objects → Host → Maintenance mode to How to → Managing ADCM → Maintenance mode. Also, added information about MM for ADCM services and components.
In the UI overview article, described how to load logs on the JOBS tab.
Added Release notes.
Added the Creating a simple bundle article.
Restructured Release notes for previous releases by moving some notes from New features to Improvements and Misc/Internal.
Released the first version of the ADS documentation, which includes the following articles:
Online installation (with subsections)
Offline installation (with subsections)
Service actions (with subsections)
Released the first version of the ADCM documentation, which includes the following articles:
Added new articles to the How to → Data querying section:
Added new articles:
Restructured and extended the Password authentication article.
Updated the left navigation menu structure (to reduce a number of elements at the top level):
Moved articles related to database access to How to → Manage database access.
Moved articles related to database connections to How to → Connect to ADPG.
Moved articles related to data queries to How to → Data querying.
Added links for new articles to the product home page.
Added the ability to select a product version via the Select version drop-down list in the left.
Reflected changes in the ADPG release dated 30.06.2022:
Added new configuration parameters: effective_cache_size, maintenance_work_mem, work_mem, min_wal_size, max_wal_size, wal_keep_size, huge_pages, superuser_reserved_connections.
Added Release Notes.
Restructured the How to → Recommended ADPG settings and References → postgresql.conf articles. Instead of them, left one article References → Configuration parameters, which includes all ADPG parameters that can be configured via ADCM.
Added Logging.
Updated the Requirements for SSL certificates article.
Updated figures in the Tutorials → Security section (sizes and dark mode effects).
Actualized Release Notes.
Replaced the hadoop name in the documentation links by ADH.