ADO releases

Added dbt (1.11.3.1) service for data transformation workflows with support for dbt Greengage adapter included

New Git Sync service for automatic synchronization of DAGs and dbt projects from Git, including syntax checks, file filtering, dependency management, and observability

Added support for upgrading from Community Edition (CE) to Enterprise Edition (EE) within the same version

Implemented rollback after upgrade functionality for ADO versions

Added support for Astra Linux SE 1.8.4 Orel and Astra Linux SE 1.8.4 Voronezh

Added Airflow provider for Apache HBase with support for Thrift2 protocol for data operations (put, get, scan, batch) and HBase CLI for administrative tasks such as backup and restore, enabling table management, row-level operations, including batch and pooled (parallel) processing, and cluster maintenance within DAGs

Added Airflow provider for Apache Ozone based on native Ozone and Hadoop CLI tools, enabling management of volumes, buckets, objects, and data transfer operations. It is focused on native Ozone operations and does not replace or rely on S3-compatible APIs

Upgraded the Airflow version to 2.10.5_arenadata1

Upgraded the Monitoring version to 1.3

Upgraded the duckdb version to 1.4.4

Added support for integration with services requiring client access on workers (for example, ADH Spark) via shared hosts concept

Added support for connection strings to Metastore HA clusters

Added proxy server support for package repositories

Implemented support for constraints when managing Python dependencies

The Info tab now takes custom configuration settings into account

Added support for ALT Linux 10.2 SP

Added support for Ansible 2.16

Implemented automatic removal of status check artifacts during host-component mapping changes to prevent false alerts

Airflow and Redis no longer fail to start on new hosts when moving components from hosts in maintenance mode

Fixed failure of the Sync requirements action on AltLinux

Minimum required ADCM version is now 2.9.0

Prometheus 1.2_arenadata1

Implemented support for maintenance mode for services

Added the ability to manage Python dependencies via ADCM

Added support for Astra Linux SE 1.7.6 Voronezh

Manage SSL action now also manages monitoring options

Monitoring configurations can now be set granularly using scrape_config_files

Internal refactoring has been performed for optimization and safe operation

Flower no longer fails to switch to HTTPS after enabling SSL

Fixed missing airflow.flower group check in the flower_scraper.yml template

Minimum required ADCM version is now 2.6.0

The Airflow bundle and package were refactored to add the ADO version rollback feature. This will be available starting with the next release

Redis is now a cluster service for ease of configuration and deployment

A new monitoring service based on Prometheus and Grafana has been implemented

Added support for Node Exporter out of the box

Added support for statsd-exporter out of the box

Added dashboards in Grafana that display host metrics, Airflow cluster metrics (servers and workers), running DAGs, and Celery queues

DAG Processor and Triggerer are divided into separate Airflow components for granular cluster setup

Flower component configuration became more detailed and offers more options

Added the ability to natively configure a secret backend using integration with HashiCorp Vault

The link to the Flower web interface is now displayed in the info block

The service configuration now explicitly displays all settings with their descriptions. Additional parameters can be set through the custom section

Introduced a single action for changing the service topology (Add, remove, move components, etc). You can run it both for a service and for the entire cluster

Fixed errors that occurred when parsing Airflow config with special characters in secret_key

Fixed an error in the ulimits configuration

The minimum ADCM version now is 2.5.0