ADQM releases

Increased ClickHouse version to 25.8.7.3

Extended the Advanced configuration parameters section of the ADQMDB service configuration with the Advanced custom XML field, an XML value of which is validated at the precheck stage and injected into the config.xml main configuration file

Enabled ZooKeeper dynamic reconfiguration for expanding/shrinking an ensemble without the service restart

Added options to enable SSL for components of the Monitoring service through the Manage SSL interface

Added the ability to delete mapped services in the created and installed states via the icon on the Services page of the ADCM interface

Added the top-level Coordination system parameter instead of the Engine group with a single System parameter on the configuration page of the ADQMDB service

Implemented SSL support and corresponding settings for the Pushgateway component of the Monitoring service

Improved handling of JDBC bridge packages during upgrade and rollback, including service stop, cleanup, and downgrade autotests

Implemented automatic deletion of obsolete data sources from the JDBC bridge configuration

Added statuschecker removal during component shrink operations

Improved the Monitoring Clients service state handling by adjusting the service state before and after bundle switch

Added validation and permission setting for the /var/lib/clickhouse directory during installation

Ensured that services in the maintenance mode remain in Prometheus targets only if the host is reachable

Corrected behavior when all ADQMDB or ZooKeeper hosts are in the maintenance mode

Ensured that upgrades fail correctly if any cluster host is in the maintenance mode

Fixed the ADQM_arenadata_enterprise attribute error occured during upgrade actions on the Community edition

Fixed the installation error for allocated ClickHouse Keeper

Fixed an error occured during the Add hosts action run for Chproxy with unreachable ADQMDB hosts in the maintenance mode

Resolved failures of the ADQMDB’s Reconfig and restart action occured when all shard hosts were in the maintenance mode

Introduced maintenance mode for ADQM

Added support for Alt Linux 10.2

Added support for Astra Linux 1.7.6 Voronezh

Increased ClickHouse version to 25.3.2.39

Upgraded clickhouse-copier — it now supports all schemas related to ADQMDB version 25.3.2.39

Implemented the Add/Remove components action for all services of ADQM (instead of the Add Server(s), Remove Server(s), Add JDBC Bridge, Remove JDBC Bridge, Shrink, and Expand actions)

Added the jdbc-mysql-connector and jdbc-postgresql packages into the ADQM bundle

Returned the session_log parameter to the Log settings section on the Configuration page of the ADQMDB service after fixes in ClickHouse upstream

FQDNs are now used during Zookeeper installation

FQDNs are now used in the remote_servers section of /etc/clickhouse-server/config.xml

Password of the default user should now have a minimum length of 8 characters and should not contain special characters

Added HTTPS support for Enterprise Tools

Removed the old monitoring service based on Diamond

Added the Manage SSL cluster action

Implemented secure connection to ADQMDB in Chproxy

Increased ClickHouse version to 24.8.8.17

Added more parameters to the Encryption codecs for tables section of the ADQMDB service configuration and renamed it to Encryption

Added encrypting passwords

Added the Metrics activatable group of parameters to the ADQMDB, Clickhousekeeper, and Zookeeper service configurations

Removed autorestart options from the Reconfigure and restart action of the Monitoring service

Enabled auto-activation of the Metrics parameter group for ADQM services when Prometheus is installed

Implemented allocation of node exporter on all hosts after upgrade

Added a pattern check to the Clickhousekeeper’s Listen host field

Password for the default user removed from all configs of clickhouse-client

Cluster options from the Reliability control section are used to retry the task Create Clickhouse znode

FQDN is used in Chproxy config

Removed the logo-container HTML block for playground (/play) in ADQMDB

Fixed a template for the Proxy wildcarded users configuration of the Chproxy service

Updated ADQM SSL defaults and permissions

Fixed statuschecker

Refactored an error message displayed on the Ansible [check] tab while checking Chproxy

Increased the minimum version of ADQM for upgrade to 23.8.2.7.1.b1

Increased ClickHouse version to 24.3.11.7-lts

Abort of the cluster upgrade (see the Abort the upgrade action) now includes a step to remove ADQM packages if they have been updated

ADQM now supports Ubuntu OS

Added the Custom JRE section to the cluster configuration where you can set a custom value to the JAVA_HOME variable

Enabled custom JRE package installation on Astra Linux

Added the ability to configure multiple LDAP servers

Introduced rolling upgrade for ADQMDB since ADCM version 2.3

Introduced rolling restart for ADQMDB since ADCM version 2.3

Added the retention_time parameter to the Prometheus settings section of the Monitoring service configuration in ADCM

Moved Prometheus tasks to the cluster level

Fixed the Manage Kerberos action failure occured when there were special characters in a Kadmin password

Fixed an issue with deleting the Monitoring service after adding an empty host

Increased the minimum version of ADQM for upgrade to 23.3.2.37.1.b1

Increased the minimum version of ADCM to 2.2.0

Removed the check Baje

Increased ClickHouse version to 24.3.2.23-lts

The minimum version of ADCM is now 2023.04.21.12

Added the adqm-clickhouse-copier package for copying between clusters and resharding data (replacement for clickhouse-copier)

Log output in ADCM is now available for non-starting services

Implemented support for SSL between ZooKeeper and ADQMDB

Replaced old actions for Kerberos management (Enable/Disable/Reconfig Kerberos) with a new action — Manage Kerberos

Included LDAP options to specify bind_dn and user_dn_detection

Added functionality to delete the Zookeeper service using the icon on the Services page

Implemented functionality to remove legacy monitoring

Added the asynchronous_insert_log parameter to the Log settings section of the ADQMDB service configuration in ADCM

Added statuschecker reinstallation for the Chproxy and Clickhousekeeper services

Fixed an error related to the fqdn attribute, which occurred while installing ADQM with allocated ClickHouse Keeper

Implemented a check of the hosts in the cluster topology structure

Increased ClickHouse version to 23.8.2.7-lts

Increased ZooKeeper version to 3.8.3

Introduced the Prometheus-based monitoring service (the recommended way to install monitoring in ADQM) and deprecated monitoring cluster support for ADQM

Introduced new Grafana dashboards with a new General dashboard

Added the jdbc bridge log path setting to the JDBC Bridge configuration section of the ADQMDB service configuration in ADCM

Implemented CA certificate support for inter-server communications. Added the Enable secure intra-cluster communication option (instead of Interserver protocol) to the Intra-cluster communication security section of the ADQMDB service configuration settings

ClickHouse errors are now displayed in ADQM jobs

Storage settings specified in ADCM now properly sync with storage.xml

Implemented automatic creation of needed directories for local disk paths

Added disk path validation to prevent directory conflicts

Improved reliability in shard and replica management

Included checks for undefined storage policies to the Reconfig and restart action of the ADQMDB service

Implemented the Disable validation option for the Reconfig and restart action of the ADQMDB service to bypass configuration checks

Creation of the cache over local disks is no longer supported

Increased ClickHouse version to 23.3.2.37-lts

Implemented support for the gRPC network interface. Added the Enable gRPC section to the Configuration page of the ADQMDB service

Implemented the ability to define requirements for the complexity of user passwords. Added the following parameters to the User password options section of the ADQMDB service’s configuration page: Allow Implicit_NO_password, Length of password, Include Upper-case, Include Lower-case, Include Number, and Include special symbols

Added the Encryption codecs for tables section to the configuration parameters of the ADQMDB service, where you can specify keys for encryption codecs

Implemented support for RED OS in the Enterprise version of the ADQM bundle

Improved the security for ClickHouse directories and configuration files

Added the check that a storage policy contains at least one volume

Increased ClickHouse version to 22.8.12.45-lts

Added support for Astra Linux to the Enterprise edition of ADQM

Implemented the ability to configure Kerberos authentication in ADQM via the ADCM interface

Implemented the ability to install ClickHouse Keeper as a separate service

Added support for ClickHouse Keeper logging (a log file is saved to the /var/log/chkeeper directory)

Implemented support for SSL in the Chproxy service

Added the relaxed and once values for the verificationMode parameter and additional certificate checks depending on this parameter values

Added new parameters to the client configuration file to work successfully with SSL/TCP enabled

You can now pass an integer value to the Max concurrent threads parameter to specify the maximum number of query processing threads

On the Configuration page of the ADQMDB service, the session_log parameter is removed from the Log settings section

Increased ClickHouse version to 22.8.6.71-lts

Implemented the Enable auto core dump and Disable auto core dump actions for the ADQMDB service in the ADCM interface

Implemented a set of improvements to increase the security at the level of interaction between cluster hosts, SSL support, Chproxy and ClickHouse interaction

Refactored the Configuration page of the ADQMDB service in the ADCM interface: improved descriptions of some parameters, deleted the external_dictionaries_path and external_dictionaries parameters from the Other section, and moved the Other section to the end of the page

Extended a set of pre-checks before an ADQM cluster installation

Implemented the concurrent_threads_soft_limit parameter that allows you to limit the number of query processing threads

Added the Disable SElinux and Disable Firewalld options to the cluster configuration page in the ADCM interface

Excluded the Baje proxy service from ADQM

Added Alt Linux version check before installing ADQM

Added the Chproxy service

Fixed an error occurred when upgrading ADQM on Alt Linux

Fixed incorrect switching of a cluster status from upgradable to installed during the cluster upgrade

Changed ADQM package names so that they differ from names of ClickHouse packages

Increased ClickHouse version to 22.3.2.2-lts

Added support for Alt Linux 8.4 SP

Added the ClickHouse Keeper component

Expanded management options for built-in logging tools

Added checks of monitoring services installed in an Enterprise Tools cluster before importing monitoring settings into an ADQM cluster

Fixed: ADQM bundle upgrade could lead to loss of cluster configuration data if the Default cluster topology field was set to an incorrect cluster topology (for example, shards and/or replicas were unsorted or a shard/replica identifier contained a space)

Implemented the Reinstall status-checker action for a cluster in the installed state. It runs the status-checker deployment scripts for services as well as for Docker containers

Added the Advanced configuration parameters section to the Configuration page of the ADQMDB service

Fixed the Baje proxy service installation error

Fixed an error with offline installation of the ZooKeeper package

Increased ClickHouse version to 21.8.8.29-lts

Increased JDBC bridge version to 2.0.6

Increased ODBC driver version to 1.1.10

Added the ability to map roles from an LDAP directory to ADQM roles and assign these roles to authenticated users (see LDAP authentication)

Implemented the Expand and Shrink actions for the Monitoring Clients service

Added support for Alt Linux 8.2

Added retries to check JDBC bridge

Changed the logic of adding the log_queries parameter to the default settings profile in the users.xml file

Added support for RHEL

Included checking of component versions to the Check action

Fixed an issue with importing the HTTP Mirror service of an Enterprise Tools cluster into an ADQM cluster

Increased ClickHouse version to 21.3.11.5

Increased ClickHouse version to 21.3.4.25-lts

Implemented the ability to install ADQM without Internet access (see the Offline installation section for details)

Fixed a Zookeeper service error occurred when performing the Expand action

Fixed an issue with skipping ADQMDB dashboards when installing monitoring

Fixed an issue with loading more than one Avro-formatted message from Kafka into a ClickHouse table

Increased ClickHouse version to 20.8.13.15-lts

Increased JDBC bridge version to 2.0

Implemented the ability to use an LDAP server for user authentication

Added Zookeeper check after installation

Fixed an issue with installing an ADQM cluster when using the external ZooKeeper

Fixed an error in the users.xml file: the same IP address was duplicated in the networks list

Increased ClickHouse version to 20.8.11.17-lts

Added parameters to configure a default user and a default settings profile

Implemented creation of macros for multiple cluster topologies

Deleted the Create user and Delete users buttons

Increased ClickHouse version to 20.8.4.11-lts

Increased ClickHouse version to 20.3.20.6-lts

Increased ClickHouse version to 20.8.2.3-stable

Added the ability to specify Kafka configuration parameters

Increased ClickHouse version to 20.3.13.130-lts

Added the following parameters to the Configuration page of the ADQMDB service in the ADCM interface: Cluster Configuration, Storage Configuration, User policy, query_log

Updated the maximum version of Enterprise Tools (ET) to 2020022800

Added the ability to specify a username and password for replicas in the remote_servers section of the config.xml configuration file

Fixed: incorrect minimum version for an upgrade

Increased ClickHouse version to 20.3.10.75

Fixed Zookeeper service check error occurred when performing the Check action for a cluster

Updated the maximum version of Enterprise Tools (ET) to 2020022800

Refactored the ADQM bundle

Increased ClickHouse version to 19.14.11.16-lts

Added support for Alt Linux

Divided the ADQM bundle into the Community and Enterprise versions

Updated EULA for the Community version

Added a window to sign the license agreement after downloading the bundle

Added the Clickhouse JDBC Bridge component to the ADQMDB service

Implemented the ability to use an external ZooKeeper