ADS releases
3.3.2
Date: 11.04.2024
Added a new cluster configuration parameter Precheck packages that enables/disables package checks when performing actions Upgrade, Install, Expand. Checks are disabled by default |
Changed service versions to 3.3.2:
|
Changed service versions to 7.3.2:
|
Added the ability to configure connection to JMX using login/password |
Cluster actions Enable Kerberos, Disable Kerberos, and Reconfig Kerberos have been replaced with Manage Kerberos that performs general improved Kerberos management (enable, disable, configure) |
Fixed issue with displaying incorrect information in NiFi configurations after enabling the Ranger plugin |
2.8.1
Date: 17.10.2023
Implemented support for RedOS in the Enterprise version of the ADS bundle |
Added an additional GitFlow Provider to NiFi |
Implemented the ability to customize:
|
Changed version of NiFi to 1.20 |
Implemented encryption of NiFi configuration parameters |
Fixed a problem with displaying irrelevant data in the Kafka-Manager service |
Maximum ADPS version — 1.0.4 |
Minimum ADCM version — 2023.10.10.08 |
1.8.2
Date: 18.07.2023
Implemented support for Astra Linux in the Enterprise version of the ADS bundle |
Reworked user authentication via SASL PLAINTEXT and Basic Auth to use secretmap entries in the ADCM interface |
Implemented showing Confluent licenses in ADS when adding services during cluster installation |
Implemented hostgroup settings for all services |
Fixed issue with |
Fixed issue with bootstrapServers and kafkaConnectClusters export being overwritten after restarting Kafka and Kafka Connect services |
Fixed issue with existing znode before creating ZooKeeper node |
Fixed issue with deleting the Monitoring Clients service using the icon |
Variables instead of hardcode for kafka-connect log4j |
1.8.1
Date: 13.04.2023
Changed version of ZooKeeper to 3.5.10 |
Changed version of Kafka Connect to 2.8.1 |
Added actions for Schema Registry service Expand and Shrink |
Added installation of the Apache NiFi - MiNiFi - Toolkit at the same time as the MiNiFi Agent component. MiNiFi Toolkit is designed to create MiNiFi configuration files from exported NiFi templates |
Added the ability to configure services for a group of hosts for MiNiFi service |
Added the ability to configure authorization on the MiNiFi C2 Server for a group of hosts |
Added new log4j templates for the ksqlDB service, available for modification during service components configuring:
|
Added logging level parameters to the components menu that can be changed during service components configuring |
Auto restart of NiFi when authentication is being disabled (without using the Restart service action) |
Implemented the ability to use the Kafka Connect service separately from the Kafka service |
Added the Force rewrite services SSL configuration flag when starting Enable SSL action |
Implemented support for the Hive 3 processor for the NiFi service |
Implemented the connect-distributed-log4j.properties log level switch for the Kafka Connect Worker service component |
Fixed an issue with ADS cluster data in ADSCC configuration when importing from ADS to ADSCC |
Fixed a bug with NoNode ZooKeeper |
Fixed Kafka Connect limit error in autotests |
Fixed a bug when starting the Disable SSL action |
Fixed an issue with using wrong ports for hostgroup configuration when triggering Enable SSL action |
Fixed a bug in ZooKeeper when creating znode |
Fixed an error with ZooKeeper installation |
Fixed an |
Fixed a bug that occurred when installing more than one instance of Schema Registry |
Fixed an |
Fixed issue with incorrect display of NiFi UI port overridden via configuration group for one host |
Fixed a problem with creating a path when installing ZooKeeper |
Fixed |
Fixed an issue with restarting the NiFi-Registry when a configuration group for NiFi is created |
Fixed an issue with starting Kafka after changing |
Fixed an issue with starting Schema-Registry in tests when upgrading to version 1.7.X |
Fixed an issue with disabling SASL PLAIN when SSL is enabled and NiFi is not installed |
Fixed an issue with applying an SSL configuration change to a host |
Fixed an issue with deleting multiple NiFi nodes |
Removed double check when starting Enable SSL action |
Changed name of KSQL service to ksqlDB |
Disabled support for updating versions earlier than 1.4.11 |
1.8.0
Date: 02.02.2023
Added the ability to delete a service from a cluster in the ADCM interface |
Implemented support for Alt 8 SP in minifi.sh for NiFi service version 1.18 |
Changed versions:
|
Fixed an issue with NiFi Server Ranger plugin activation when upgrading from 1.6.X, 1.7.0, and 1.7.X |
Fixed an issue with exporting ADS cluster name to ADSCC cluster after upgrading ADSCC |
Fixed an issue with updating basic information about services after applying actions Expand and Shrink |
Issue | Workaround |
---|---|
After upgrade of a running ADS cluster to version 1.8.0.b1, all processors that have certain parameters (password, web hook url, auth token, etc.) in the NiFi Server interface will be flagged with a warning |
To solve the problem, you need to:
|
1.7.2
Date: 10.01.2023
Added ability to clear user and authorizer files when enabling SSL in NiFi |
The basic authentication is now available for the following ADS services:
|
Fixed an issue with creating service keytab |
Fixed an issue with cluster crashing after misconfiguring NiFi settings when enabling SSL |
Fixed an issue when enabling SSL in a cluster with NiFi service and monitoring without installing ADPS |
Date: 06.12.2022
1.7.1
Date: 17.10.2022
Added support of AltLinux 8.4 operating system for ADS |
For the NiFi service, the Ranger authorization plugin has been added, the ability to add or remove permissions for processing messages in NiFi has been implemented |
Added support for Kafka Connect service and Mirror Maker 2 mechanism for ADS. For more information about Mirror Maker 2, see Mirror Maker 2 |
1.7.0
Date: 16.06.2022
Added LDAP/AD authentication for NiFi service |
For ADS in ADCM, the ability to delete a user is implemented |
For the NiFi service, the ability to work with the |
Switching of the logging level ( |
For ADS in ADCM, the ability to configure channel protection via the SSL protocol has been implemented |
Kafka bump to new version stack |
1.6.2
Date: 16.12.2021
Added the ability to use Active Directory as a Kerberos store for ADS |
For the ZooKeeper service, the ability to add a set of logs for deletion (tear-down) has been implemented |
Fixed a bug occurred when running the Reinstall status checker cluster action |
Added full testing of the RedHat 7.9 volume license stack in ADS |
Date: 29.10.2021
Added Reinstall status checker action for ADS in ADCM |
Implemented the ability to run |
Kafka topic data storage time not specified |
Added autotests for installing ADS with Kerberos support by service |
Added autotests for Upgrade with installed Kerberos |
Updated |
Date: 24.09.2021
Docker for ADS is released to use |
Added a list of service log locations to the bundle configuration |
The authentication protocol Kerberos is implemented for ADS |
For ADS, a provisioning mechanism infrastructure has been created to enable Kerberos authentication |
Fixed an issue with ADS and Enterprise Tools integration |
For the ZooKeeper service, a bug with the Check action has been fixed — instead of performing a health check, it performed the installation and configuration of the service |
Fixed a bug in starting offline installation on RH 7.9 |
Fixed incorrect execution of actions on the ZooKeeper service |
Fixed offline installation error |
For the NiFi service, incorrect work when passing metrics to the Graphite service of the Monitoring Clients cluster has been fixed |
Fixed a bug with non-uniform hostnames for the Graphite service |
Fixed a bug with duplicate configuration keys |
Fixed intermittent validation error for Kafka service |
For the NiFi service, an error has been fixed that occurred when the Shrink action was performed if the NiFi node did not have time to connect to the cluster |
Fixed a bug for the NiFi service that occurred when the Expand action was performed when the wrong host was selected |
For all services, a bug has been fixed: services did not change the state to |
Changed ADS bundle format version |
Disabled autostart for Shrink action |
Changed maximum import version |
Added branch parameter to .gitmodules |
Integrated repository adcm_job_repo into ADS |
Added the ability to update the bundle without rebuilding packages |
Created a port map for ADS components |
Created a pack-file for offline installation of CE with Enterprise Tools |
Added autotests to check if Ranger works with Kerberos |
1.6.0
Date: 09.03.2021
Implemented SASL/PLAIN support for Kafka, KSQL, Schema-Registry, Kafka-Rest, Kafka-Manager services |
Implemented the ability to add/update users for SASL/PLAIN |
Implemented ADS integration with ADPS (Arenadata Platform Security) |
Implemented support for Ranger Kafka Plugin |
Implemented support for Service Dependency Tree |
Implemented the Check service action to check services using the systemctl utility |
Implemented the division of the ADS bundle into the Enterprise version and the Community version |
Increased Kafka version to 2.6.0 |
Increased KSQL version to 0.11.0 |
ZooKeeper repository and Alt repository uploaded to Google |
For the Schema-Registry service, the check has been improved |
Improved test execution time and added new fixtures from the plugin |
Improved Schema-Registry configuration options |
Refactored Kafka Cluster post task in Kafka-Manager |
Refactored adding NiFi Metric Report tasks |
Refactored use of |
Refactored the NiFi service health check |
Refactored services_dependencies_check.yaml |
Refactored adcm_role_jmxtrans |
Refactored services |
Refactored actions and states of the cluster and ADS services |
Graphite and Grafana imports moved to Monitoring Clients service |
Migrate Kafka-Manager to a Docker container |
All service checks have become more informative |
It is now possible to add parameters to the Schema-Registry service config |
Fixed a problem with launching the Ranger plugin |
Fixed issue with Monitoring service status after Ugrade action |
Fixed issue with Kafka version support when upgrading from 1.4.X |
Fixed a problem with starting the Schema-Registry service after the update |
Fixed bug in Kafka-Manager |
Fixed bugs in |
Repository in config.yaml split with |
ADS 1.6.0 uploaded to Google |
Added Guava library to |
Verified use of |
Added |
Moved ADS autotests to SSH provider |
For autotests, all file accesses are organized regardless of the current working directory |
Added creation of clusters with a common function from the plugin in autotests |
Refactored tests to use only scope fixtures |
Added |
Updated tests for using the YCC 2.11 bundle |
Added service dependency tree tests |
Added processing of tests for different editions |
Implemented assembly of components with a dependency on ZooKeeper 3.5.8:
|
Implemented build ZooKeeper 3.5.8 |
Implemented build Kafka 2.6.0 |
Implemented standardization of service checks |
Implemented the assembly of the latest stable bundles for ADS 1.6.0 |
Refactored implementation of service dependencies |
Added autotests of monitoring clients |
Added MiNiFi autotests |
1.5.0
Дата: 24.04.2020
Created open repositories:
|
Introduction of MiNiFi service for ADCM |
For the MiNiFi service, the following actions have been implemented:
|
Monitoring implemented for MiNiFi service |
Added common actions for MiNiFi service for ADS in ADCM |
Increasing service versions:
|
Added support for Kafka 2.4.0 version in Kafka-Manager |
Kafka-Manager downgraded to 1.3.3.23 |
Added the ability to monitor the NiFi service |
Refactored Kafka-Manager user interface |
Refactored ADS bundle for Altlinux |
Refactored ZooKeeper role for Altlinux |
Refactored service_main_info.yaml |
Refactored Schema-Registry service |
Refactored Kafka-Manager service |
Refactored processing of cluster and service states |
Changed the unit of Kafka metrics |
Refactored Check action of Kafka service |
Refactored calling the |
Refactored actions of clusters and services for several types of scenarios |
Refactored roles of repositories |
Refactored NiFi Registry configuration for version 0.5.0 |
Refactored NiFi configuration for version 1.10.0 |
Refactored Kafka configuration for version 2.4.0 |
Refactored Kafka role |
Refactored ZooKeeper role |
Rebuilt MiNiFi package |
Fixed a bug with building the Schema-registry service |
Fixed a bug with creating custom NiFi service directories |
Fixed a bug with installing the MiNiFi service (an Ansible task crashed) |
Fixed issue with encoded template name in external link to MiNiFi C2 server |
Fixed issue with performing Expand action for NiFi service |
Fixed destructive actions when checking the repository |
Fixed problem with updating child packages when updating main packages |
Rebuilt ZooKeeper service package |
Fixed Diamond collector issue for MiNiFi service |
Fixed Run as user runtime issue for MiNiFi agent |
Fixed Kafka-Manager service crash after version change |
Fixed an issue with NiFi builds |
Fixed issue — |
Fixed |
Changed the logic of loading the bundle version |
For the ZooKeeper service, the Shrink and Expand service action tests have been Refactored when connected via an IP address |
For the NiFi service, tests for the Shrink and Expand actions have been added |
For the ZooKeeper service, tests for the Shrink and Expand actions have been added |
Added check for Shrink and Expand results for ZooKeeper service |
Added Kafka REST Proxy server update |
Add a call to |
A test for the operation of the Shrink action has been added for the Kafka service |
Added |
Enable |
For the MiNiFi service, a script has been developed to transfer metrics to Graphite |
Added Upgrade action test for ADS 1.3.X and 1.4.X bundles |
Moved service_rolling_restart.yaml to |
Added invisible configuration to config.yaml for computed service variable |
Added update task for ZooKeeper in 3.5.6 |
Documents prepared for version 1.5.0.1 |
The latest stable packages for ADS 1.5.0 have been built |
Migrated ADS to Altlinux |
Added cluster upgrade tests |
Added a default hidden parameter for the ZooKeeper repository to the service configuration |
Added tests for Shrink and Expand actions for a cluster |
Added NiFi dependency check for MiNiFi service |
C2 MiNiFi server developed |
Added restart tag to |
Added license acceptance in tests |
Moved changes from |
Updated license agreement |