ADB 6 releases

Upgraded gpbackup to 1.30.5_arenadata16

Upgraded diskquota to 2.3.0_arenadata6

Upgraded kafka-greenplum-pxf-connector to 1.1.0-pxf-6.x

Upgraded pgbackrest to 2.52_arenadata6

Upgraded tkh-connector to 1.5.0

Full interconnect support for the Proxy type has been integrated into ADB (see ADB → Interconnect properties in Configuration parameters)

ADB is now compatible with RedOS 7.3

Configuration files are now validated without using log files

PXF is now compatible with ADH version 3.3.6

Implemented ADBM 2.2.3

Implemented ADB Control 4.10.3

The Tkhemali/ADB ClickHouse Connectors now support messages larger than 4096 characters

Edge case handling in gpbackup has been improved

gprestore now uses the actual attnum values from the catalog during restoration, ensuring data integrity

A new filter option is available in pgBackRest for the archive-get and restore commands

The gpbackup S3 plugin now includes the logger_verbosity option

Nested exception information is now available in PXF logs when needed

The skip-file usage in gprestore has been enhanced

gprestore now shows actual error messages more frequently

The PXF platform has been updated to use Spring Boot 3.3.2

An option to save the gpexpand logs prior to rollback has been introduced

ADB and all its components now require Java 17

.bash_profile is now supported on Astra and Ubuntu

Log rotation scripts now better accommodate database names

gpexpand has been optimized to handle partitioned tables that span multiple schemas more effectively

The logging behavior in gpperfmon has been unified

The PLContainer Docker instance is fully operational again

Optimizations for MIN/MAX are no longer applied to inner plans of lateral joins

GUC sync will no longer forget about temp tables

gpbackup and gprestore no longer hang if helper processes fail

JSON output is now available for the EXPLAIN ANALYZE statistics

Schema types are now correctly backed up

The Kafka Connector automatically sets up pxf-profile after installation

The ADB ClickHouse Connector now handles cyrillic characters correctly

Restoration of arenadata_toolkit has been improved

Improvements in PXF ensure user impersonation is handled more accurately

A delete action for failed ADBM instances has been added to the bundle

ETags will be parsed case-insensitive now

Support for over 512 fields has been added to the ADB ClickHouse Connector

The core-app.log files are now included in the log rotation

Clusters running in the standalone mode with extensions now shut down correctly

Software package cache updates automatically when needed

In CentOS and Astra Linux, before installation of ADB 6.27.1.58 or upgrade to this version, you should manually install Java 17 on cluster hosts and fill in the JAVA_HOME parameter on the cluster configuration page

Significantly enhanced and extended the performance and scope of PXF push-down

Upgraded gptkh to 1.1.5

Upgraded pgbackrest to 2.52

Upgraded PXF to 6.10.1_arenadata15

Upgraded gpbackup to 1.30.5_arenadata15

Implemented ADBM 2.1.2

Implemented ADB Control 4.9.1

Queries on unresponsive segments do not longer hang indefinitely

gprestore is now more tolerant of plugin outputs sent to stderr

PXF now supports push-down filters for the following types: NUMERIC, TIMESTAMP, and TIMESTAMPTZ

PXF now supports years with more than four digits

PXF now supports push-down for immutable and some stable functions

gpadmin logs now rotate automatically

Updated timezones to the latest version

The COPY command now handles partitioned tables more accurately

The COPY command now can use the client_connection_check_interval GUC

gprestore no longer creates a large number of zombie processes

SEGFAULTs on the master node are now less likely

gprestore now handles missing or failed tables more effectively

Upgraded pgbouncer to 1.22.1

Upgraded PXF to 6.10.1_arenadata14

Upgraded gpbackup to 1.30.3_arenadata14

Upgraded gptkh to 1.1.4

Upgraded tkh-connector to 1.4.1

Added the ability to separate tablespaces for temporary tables from the spill/sort temporary file storage by setting the new GUC temp_spill_files_tablespaces

ADB now supports Ubuntu OS

The ADB to Kafka Connector now supports SSL

Added the ADBM CLI to simplify backup and restore processes

Implemented ADBM 2.0.4

Implemented ADB Control 4.8.8

ADB bundle: the Advanced section has been removed from the cluster action Expand

ADB bundle: the Advanced section in the ADB service configuration is now smarter

gpfdist now has the default transformation flag

Grafana dashboards and ADCM API now include more thread-related metrics for PXF

Added aliases to the ORCA plan (EXPLAIN)

ORCA requires fewer columns for delete operations

gpexpand now handles already expanded tables properly

PXF can better export JSON/JSONB fields to Postgres

PXF will never ignore the jdbc-site.xml settings to determine the JDBC driver

Improved performance of the DDBoost plugin

Improved the ADB performance on CPUs with the Power architecture

gprestore works better with the --cluster-resize parameter

Improved security of the ADB source code

ADB Control now supports external ADQM

ADB Control and ADBM no longer use Nginx

ADB bundle: the pg_hba.conf file is now validated before applying

ADB bundle: when SQL files are used instead of text to run SQL commands, the ON_ERROR_STOP option is added

The ADB Control connection URLs automatically switch to Standby when it is activated

ORCA generates a plan for queries with GROUP BY by a non-primary key

ORCA generates correct plans for queries where EXCEPT is above LEFT JOIN

Improved the locking strategy for partitioned tables

The restore process will not remove old WAL files if archive_mode=always

LDAP authorization requests are processed more correctly

The LC_MONETARY and LC_TIME settings are now properly synchronized across query processes

The adb_collect_table_stats query now works for partitioned tables

Column definitions in the gpbackup metadata will no longer double

The COPY FROM PROGRAM command now properly closes the program in case of an error

PostGIS extensions now work during the cluster installation tasks

The ALTER TABLE ADD PARTITION command now handles dropped columns more properly

Improved performance when working with ClickHouse

gpbackup has a lower probability of Out Of Memory (OOM) errors

The address availability check for UDP interconnect has been reinstated

Improved the gpbackup speed

gprestore now handles errors better

ADB Control no longer ignores changes in the scheduler configuration files

Improved the resource release callback logic for tkh-fdw

The ADB Control reconfiguration no longer fails after adding incorrect options

The PXF locale can now be configured via ADCM

Improved handling tkh-fdw with the CDB_MOTION_DEBUG flag

Synced with upstream Greenplum Database 6.26.2

Upgraded pgbackrest to 2.50_arenadata4

Upgraded tkh-connector to 1.4.1

Upgraded planchecker to 1.1.1

Upgraded gptkh to 1.1.3

Upgraded PXF to 6.9.0_arenadata13

Upgraded gpbackup to 1.30.3_arenadata10

Upgraded librdkafka to 1.9.2

Added the PXF cluster option to reload profiles

Added the option to change the PXF_BASE directory

Added tablespace_location to arenadata_toolkit.db_files_current

Added the parallel_processes option to the Redistribute cluster action

Implemented ADBM 1.7.3

Implemented ADB Control 4.7.5

Unset the gpadmin default password in the ADB bundle

Reset ADB on Astra Linux from default Axiom Java to openjdk

Replaced Java 8 with Java 11 in all components of Arenadata DB

Added a date to the logback parameters pattern

Added the ability to use a subdirectory for a custom Docker registry

Implemented toast size calculation for adb_relation_storage_size

Added support for Greenplum specific query tree nodes to query jumbling logic

Removed the confusing option Force Enable Monitoring from PXF service parameters

Added the LDAP settings check in the ADB service during the Precheck, Check, Install, Reinstall actions

ADB ClickHouse Connector did not use the USER MAPPING on segments

The adcc_agent_monitor script did not exist on new hosts after the expand

The ADB bundle option custom enterprise repo did not work with Astra Linux

db_datfrozenxid_alerter returned the script is already running error

Scheduler app logs were not written to files

The ADB bundle error Could not find the requested service diamond after removing ADM cluster

The ADB bundle on Astra Linux ignored the gpinitsystem error

The operation.py scripts failed with a DB name having contained special characters

Backup Manager pages were displayed on UI when ADBM was not installed

Host system metrics were always empty

The gpbackup-s3-plugin and gpbackup-helper processes remained after running gprestore unsuccessfully

Fixed the progress bar concurrency issue with gpbackup

Fixed possible issues detected in ORCA by svacer

Fixed possible memory leaks detected by svacer

Fixed core dump in transformValuesClause when there were no columns

Fixed incorrect memory assumption for hash join statistics

Fixed the address availability check when setting up UDP sockets in IPv6 disabled environments

diskquota could work incorrectly because of a huge memory leak if tuple copies were not freed after use

Disk space was not reclaimed to OS right after drop of a temporary heap relation

gpbackup did not use a shared snapshot for the first table in worker processes

Fixed data restore with the --backup-dir and --resize-cluster parameters to a cluster with fewer segments

Fixed the empty query_text field in the queries_history table

ORCA extracted all columns of an AO table when deleted

ORCA generated an incorrect plan with the EXISTS clause for a partitioned table

Fixed inconsistencies with Shared Scans in a postgres planner

Fixed the unable to login error that occurred when a server used tset

Fixed missing system attributes for an AO table

Fixed inserting the # symbol into a table on the ClickHouse side

Synced with upstream Greenplum Database 6.26.0

Added new metrics for PXF Monitoring: pxf status and uptime

Added the ability to choose a strategy for vacuuming in arenadata_toolkit

Added support for plpython3u

Upgraded planchecker to 1.1.0

Upgraded the adb-community/clickhouse-server image to 22.8.6.71-alpine

Upgraded gptkh to 1.1.2

Upgraded PXF to 6.8.0_arenadata12

Upgraded gpbackup to 1.29.4_arenadata7

Upgraded pgbouncer to 1.21.0

Upgraded pgbackrest to 2.47_arenadata4

Upgraded adb_ddp_plugin to 1.1.1

Upgraded diskquota to 2.3.0_arenadata5

Upgraded tkh-connector to 1.4

Upgraded plcontainer to 2.3.1

Implemented ADB Control 4.6.4

Implemented ADBM 1.6.3

Replaced the inefficient pg_catalog.pg_partitions view in arenadata_toolkit

Added ADB Control and ADBM descriptions to the main pages of corresponding services in ADCM

Renamed the Use nobarrier configuration parameter for master and segments to avoid ambiguity

Added switching from Cgroups v2 to v1 for Astra Linux 1.7.5 and higher

Optimized gp_toolkit.gp_size_of_table_disk

The pxf_fdw and tkh_fdw extensions are created in all databases when Tkhemali is complemented with ADB ClickHouse Connector

gplogfilter did not skip files if time filters were used

Fixed the extra data after last expected column error with the gpperfmon.queries_now_fast table

The coordinator did not cancel a PXF query on segments

The gp_fastsequence index could be corrupted during data recovery

ADB Control installation (via the Install service action) failed if ADB cluster had no the Monitoring clients service

It was not possible to delete a role that had a GRANT on the PXF protocol

gprestore failed if the tkh_fdw extension extension was installed

ADB ClickHouse Connector failed when trying to insert data using mpp_execute = any with staging tables enabled

Fixed the gprestore error when inserting data into pg_statistic for tables after partition exchange

diskquota did not delete entries about expired temporary tables for interrupted sessions

Metafiles were not fully restored in adb_ddp_plugin

Fixed the error when inserting a partitioned table into a leaf partition

Data inserting via ADB ClickHouse Connector resulted into SIGSEGV

gprestore --resize-cluster failed when trying to restore DISTRIBUTED REPLICATED tables

gprestore --resize-cluster failed when trying to restore empty tables

Fixed a non-quoting *.csv filter in a log compression script

Synced with upstream Greenplum Database 6.25.2

Upgraded gpbackup to 1.29.4

Added support for AstraLinux 1.7 SE "Orel" (for the Enterprise edition of ADB)

Added support for Docker CE

Added the option to choose custom JAVA_HOME for cluster

Added the Parameter archiving feature — ability to export ADB settings according to the specified schedule

Allowed PXF log output in the JSON format

Added verification of reserved characters for database names

Ensured correct ADB deployment in case of custom umask

Added checking residual gpdb processes during the upgrade action

Implemented ADBM 1.5.2

Implemented ADB Control 4.5.3

Added calculation of the root partition size to arenadata_toolkit.adb_skew_coefficients

Improved the ADB audit query

gpbackup: excluded from a backup process setting all subpartitions when the --leaf-partition-data and --exclude <root_partition> options are used (to avoid pointing out every subpartition)

Added a persistent volume for ClickHouse in ADB Control

Reset sysctl parameters to recommended values

Refactored closing connection to PXF, including fdw

Fixed: a SELECT query to arenadata_toolkit.__db_files_current failed

Fixed: ADB to ADB Connector installation failed due to the lack of extension files on segments

Fixed incorrect filling of the submit field in the queries_history table for gpperfmon

Fixed: reboot timeout was too small to fit physical servers

Fixed: a cron string was doubled for addc_container_monitor

Fixed: CA cert had extra quotes in name

Fixed: diskquota freezed in the paused state after upgrade

Fixed ORCA invalid processing of nested SubLinks under the aggregates

Implemented ADB to ADB Connector 1.0.0

Added the Uninstall action for Madlib

Implemented ADBM 1.4.0

Implemented ADB Control 4.4.0

gpbackup: removed the timeout for gprestore that caused the connection error if COPY from gpdb didn’t connect to the pipe

Replaced gp_log_system for gp_toolkit.__gp_log_master_ext in the pg_hba validation query

Fixed ORCA invalid processing of nested SubLinks referenced in the GROUP BY clause

Excluded reconfiguring of Diamond if a cluster has no monitoring

Fixed the error with an empty value of the ADB Control Docker address in pg_hba.conf

Fixed the error that occurred when the session on the master node was ended, while the sessions on the segments continued to work

Removed dynamic linking of zstd for gp_zstd_compression.so to avoid a memory leak during workfiles compression

Fixed: VACUUM made all segments inaccessible in case of a concurrent transaction

Fixed Explicit Redistribute logic for queries with SubPlans

Synced with upstream Greenplum Database 6.25.1

Upgraded pgbackrest to 2.47

Upgraded gpbackup to 1.29.1

Upgraded gpbackup-s3-plugin to 1.10.0

Upgraded madlib to 1.21.0

Added LDAP integration and synchronization with ADB from bundle

Added the Enable mirroring action to the ADB service

Added the pgbouncer-adb6 RPM with LDAP native authentication

Added the Uninstall action for PostGIS

Added the Uninstall action for diskquota

gpbackup: added the --report-dir parameter to gprestore

Implemented ADBM 1.3.3

Implemented ADB Control 4.3.3

Timezone is taken into account in the operation_log filenames for arenadata_toolkit

Added support for the EXPLAIN ANALYZE queries that contain cursor declarations

Reduced memory consumption by avoiding ORCA initialization on query executors where ORCA is never used

Fixed Unhandled ORCA memory pool init error in OOM conditions

gpbackup: table grants didn’t appear after the restore in a new schema

gpbackup: wrong DDL were created for foreign tables using kadb-fdw

Fixed a segmentation fault during a dispatch interrupt

Fixed update of ADB Control/ADBM versions in UI after cluster upgrade

The EXECUTOR role for standby left only after process of obtaining standby from Registry

Fixed inconsistency of adcc-agents with external ADB Control server endpoint

Implemented ADBM 1.3.2

Implemented ADB Control 4.3.2

Postgres config files are backed up for the purpose of ADBM Copy (Disaster Recovery)

Fixed: cluster was marked Down in ADBM when master was on the same host as segment

Synced with upstream Greenplum Database 6.24.3

Upgraded pgbackrest to 2.45

Upgraded gpbackup to 1.28

Upgraded gpbackup-s3-plugin to 1.9

Upgraded pxf to 6.6

ADB ClickHouse Connector went out of beta to GA

ADB ClickHouse Connector: implemented segment scans to support select capability

Implemented the adb_collect_table_stats function to handle a problem with NULL values in db_files_current

Implemented the arenadata_toolkit.adb_skew_coefficients view to monitor data skews

Added SASL_PLAINTEXT and SASL_SSL to ADB Kafka connector

Implemented ADBM 1.3.0

Implemented ADB Control 4.3.1

SSH connection timeout was increased to ensure spare node installation with ADB bundle

ADB ClickHouse Connector: avoided using of short-living context for edatum in scans

ADB ClickHouse Connector: avoided removing of one resource release callback inside another

ADB ClickHouse Connector: changed the send_delay_ms option to send_delay in the X-GP-OPTIONS-SEND_DELAY header

ADB ClickHouse Connector: improved initial shard selection based on segno for insert queries based on round-robin

ADB bundle was changed to use rebranded service names of ADB ClickHouse Connector (ex — Tkhemali) and ADB Control (ex — ADCC)

adb_ddp_plugin was optimized with more performant restores by means of filtered offsets

Migrated the arendata_toolkit schema to the arenadata_toolkit extension module

Fixed the gpstop error No such process with a locale other than en_US

Fixed segfault when executing a query using JOIN LATERAL

Fixed segfault when executing a competing update in a trigger

Fixed PXF migrator in an ADB bundle

Fixed the FQDN problem that occurred during the Expand action

Fixed: ORCA set improper Flow for Shared Scan nodes during translation to a physical plan

ADB ClickHouse Connector: fixed the uninitialized variable error inside the options module

Fixed creating the diskquota extension with the global option appendonly=true

Synced with upstream Greenplum Database 6.23.5

Upgraded diskquota to 2.2.1

Limited the find command depth when diskquota upgrading

Fixed diskquota 2.x to allow a huge number of rows in diskquota.table_size

PXF curl error buffer: a transfer closed with external read data remaining

Fixed: diskquota hung and blocked the cluster stopping

Synced with upstream Greenplum Database 6.23.3

Upgraded pxf to 6.5.0

Upgraded diskquota to 2.2.0

Implemented ADB ClickHouse Connector. You can use the new connector version in the beta mode simultaneously with the previous version Tkhemali Connector 1.X

Started to process the IN predicate for filter push-down purposes in PXF JDBC

Enabled SSL between Client and Master

Enabled addition of Monitoring Clients to new hosts after the Expand action

Added PXF Monitoring Grafana Dashboards

Added the ability to expand monitoring agents in the ADB bundle

Arenadata DB Command Center (ADBCC) is renamed to Arenadata DB Control (ADB Control)

Implemented ADBM 1.2.1

Implemented ADB Control 4.2.1

Refactored the logs compression script

Added additional checks for the ADB state when the Install/Reinstall ADBM actions are being performed

Removed redundant Partition Selector nodes from the DELETE operation when anti-join is used to filter for deletion

It was impossible to upgrade Diskquota directly from 1.0 to 2.1 or later

PXF: fixed the error that occurred if the year contained more than 4 digits

ADCC monitoring could not be installed when "one shot" cluster installation was used

Fixed the incorrect IP for Standby in the arenadata_segments_monitor.sh script after the cluster upgrade

The gpcheckcat test failed after syncing with 6.23

ADCC client did not re-register on the ADCC server with LDAP when running Reconfigure & Restart

The PANIC error in logs with the could not fsync file text on MIRROR after moving a database to another tablespace

Disabled the gp_enable_gpperfmon GUC if ADCC >= 4.1 is being installed/upgraded

After restarting a Master server or segment host, Graphana transmitted incorrect data

Corrected the error output for gpfdist when inserting large rows

Fixed issues with the external cluster DB addition into pg_hba.conf during the Reconfigure & Restart action

It was impossible to uninstall the ADCC service due to the Edit pg_hba error

Fixed issues with the arenadata_segments_monitor.sh script

Fixed the missing (yet claimed) tablefunc version 1.1 extension

The ADBM actual mapping state was not checked during the Install ADBM service action

Fixed: monitoring scripts could exhaust a connection pool

The connection cluster was not created automatically after the bundle installation with LDAP

After the Expand action, the unusual data appeared on a new segment in data_analyze

Fixed the incorrect never executed label in query plans

Fixed: the ADB cluster update process failed

Fixed the uninformative error that occurred when the reload process failed

The high memory consumption could lead to OOM for AOCS tables and NLJ

Upgraded pgbouncer to 1.18

Upgraded gpbackup to 1.27

Upgraded plcontainer to 2.2

Implemented a buffer parameter in the gpcheckperf utility

ADB bundle: added a checkbox to echo ADB-specific metrics to Monitoring Clients

Implemented ADBM 1.1.0

Implemented ADBCC 4.1.0

ADB bundle: removed the gppefmon dependency from ADBCC and refactored the ADBCC configs

ADB bundle: renamed Encryption Key to Alias in the PXF service

Added a precaution annotation to /home/gpadmin/arenadata_configs/postgresql.conf

Made migration of the arenadata_toolkit objects optional and unchecked by default

Components in ADB did not change their state to installed after installation

High memory utilization for queries with SQL subqueries

The service query collect_table_stats.sql periodically hung

The PXF encryption error: Encryption library was not found in /var/lib/pxf/lib/ directory

It was impossible to add the Chrony Secondary component on a new Standby host

PXF did not start with enabled option encryption: Implement check for keystore file is exist

Refactored arenadata_segments_monitor.sh to avoid crontab for a Standby node

EXPLAIN provided a wrong rows count for a WindowAgg node

The invalid byte sequence for encoding UTF8 in logs during accessing arenadata_toolkit.db_files

GPORCA produced a bogus plan for queries with CTE during handling distribution for Sequence children

The SIGSEGV error occurred when ADB read a PXF external table

Incorrect json type processing

The issue with changing an ADBCC service configuration file via ADCM

Fixed a system database name for ADBM

Fixed known issues for ADB 6.22.1.40

Placed the plcontainer Docker images (python2/python3) in our public registry

Synced with upstream Greenplum Database 6.22.1

Upgraded gpbackup to 1.26.0.7

Upgraded PXF to 6.4.2.4

Upgraded kafka-adb to 0.16

Added encryption 1.0.0

Added adbm 1.0.0

Upgraded geospatial to 2.5.4.1

ADB bundle: implemented the pg_hba custom section in the ADB service configuration

ADB bundle: added the ADBM service and the ADBM configuration page

ADB bundle: added an option to the ADB configuration to store a Docker certificate for a trust self-signed registry

Obfuscated jdbc.password in the PXF jdbc-site.xml file

Added the ability to deserialize AVRO messages in kafka-adb

Implemented ADBCC 4.0.0

Added a new system for ADB binary backups management — Arenadata DB Backup Manager (ADBM)

Made optimizations in arenadata_toolkit.db_files_history

The error occurred during the postgis extension upgrade in ADB 6.22.0

The CREATE EXTENSION command in explicit transactions failed during assertion on executors

Fixed the cross-slice interaction detection for subplans

The error with Precheck and Check actions after ADB installation

The ADBCC client did not re-register on the ADBCC server when Reconfigure & Restart was being applied

PXF might not catch a malformed chunked encoded response

The postmaster process could exhaust all signal slots under the intensive connections pressure

PXF hung indefinitely when it executed queries using the maximumPoolSize = 1 parameter

Changed logic for ADB checkstatus

Synced with upstream Greenplum Database 6.22.0

Added support for AltLinux 8.4 SP. AltLinux 8.2 SP is now deprecated

Added Data Domain Boost 1.0.0 (adb_ddboost_plugin)

Upgraded gptkh to 0.14

Upgraded diskquota to 2.0.1

Upgraded PXF to 6.4.2.3

PXF: allowed setting of Oracle parallel instructions

PXF: enabled a filter pushdown status in PXF JDBC logs

Implemented ADBCC 3.7.0

PostgreSQL planner produced a bogus plan for queries against replicated tables with SIRV functions

The SIGSEGV error occurred when ADB read a PXF external table

Fixed the lost parameter delete in a cron log rotation script

Refactored Planchecker to use an external ADBCC database

The Postmaster process might exhaust all signal slots under the intensive connections pressure

gpbackup: fixed the metadata order so that now gprestore can restore functions after the tables that are used in functions as a returning type

Fixed the projection of boolean qualifiers which attributes are not in the SELECT list

Applying the INSERT INTO command to a replicated table in combination with the SELECT FROM query against another replicated table with sequence generation failed

entrydb processed wrong slot resetting on moving a query to a resource group

A failure occurred when DynamicSeqScan had a subPlan

Failed to exchange a partition with a table having a dropped column that the table was distributed by

The SIGPIPE error occurred during fetching the external table data via the extended protocol

gptkh: fixed fetching of the actual system.tables columns in ClickHouse (according to the ClickHouse version)

Added a registry URL and arenadata-enterprise repository to the bundle configuration

Synced with upstream Greenplum Database 6.21.1

Enabled core dump files for ADB processes

Implemented ADBCC 3.6.0

Tkhemali could not process text fields with a new line character

Read data stream is released now when a partition scan is over

The EvalPlanQual routine erroneously arose for the DELETE operation over a partitioned append-optimized relation

gp_toolkit.pg_resgroup_move_query could lose RG slots

auto_explain is not running now anywhere besides a dispatcher process

ALTER TABLE erased pg_appendonly values

Fixed a gang loss during running a transaction when gp_dist_wait_status was being called within a transaction

A database process entry initialized a whole plan tree

Synced with upstream Greenplum Database 6.21.0

Implemented ADBCC 3.5.1

Optimized DML queries against partitioned tables to avoid further planning if a partition was pruned

Excluded the gpmon background process from the shared memory user list

Refactored the gpdb specific code for the dispatch result waiting

Implemented a fallback to PostgreSQL for an empty target list in CTE producer

Fixed the cross-slice interaction detection for subplans

Copying subplans for partitions by a planner broke the subplans order

gpinitsystem failed on a machine with a custom locale

gptkh could not parse engine settings with a dot symbol

kafka-adb: re-added kafka-client-2.5.0.jar to the kadb-fdw connector

Synced with upstream Greenplum Database 6.20.4

ADB bundle: added the ability to specify a cluster network to distinguish a high-speed network for the interconnect purpose

ADBCC: the Container Memory Usage panel was blank under certain conditions

Synced with upstream Greenplum Database 6.20.3

PXF: when the PXF service migrated, the rights to the directory were not being checked

PXF: the PXF_JVM_OPTS parameters could not be changed

The gpexpand_schema.tar archive was created in the directory /home/gpadmin and could overflow the space

A compatibility platform was incorrect for community bundles in AltLinux

Synced with upstream Greenplum Database 6.20.1

PXF: added PXF 6.3.0 to the ADB bundle (with ability to upgrade from PXF 5.x)

PXF: activated a PXF cluster sync command

PXF: added the PXF bin directory to the PATH variable

PXF: added the ability to override data types mapping in external tables for PXF

Added Tkhemali Connector 1.0.1 with a lot of refactoring

Added the Delete Tkhemali action

Added the Delete Kafka-to-ADB action

Added the Delete ADB-to-Kafka action

Added the -Dliquibase.releaseLocks=true parameter to the migration container for the Reconfigure & Restart action

Implemented ADBCC 3.4.0

Made editing of /etc/hosts optional

PXF: error with JDBC Hive when one of the fields was a reserved word

GPORCA failed on assert during transformation LEFT JOIN to INNER JOIN

The aggregate mode did not handle properly query finish commands from QD (Query Dispatcher)

kafka-adb: the storage option for an offset table is set explicitly now to avoid overriding

ADBCC installation failed if a cluster name consisted of more than one word

Interleaving of the append-optimized partitioned table removal and the pg_total_relation_size call for one of its partitions potentially caused SIGSERV

gptkh: fixed the tnx() function error that occurred when the data was being inserted into a partitioned table with the partitions number more than 1

Tkhemali: column names with spaces were not handled properly

GPORCA produced invalid plans for CTE (Common Table Expression) with replicated tables

GPORCA: the Gather motion merging is enabled now for singleton on a Segment

Monitor scripts were not added to crontab on the Activate Standby action

Backend server was displayed as IP while agent was displayed as FQDN on the Version page

Synced with upstream Greenplum Database 6.19.3

Implemented ADBCC 3.3.1

Synced with upstream Greenplum Database 6.19.1

Hid a server name in the HTTPS group ADBCC service

Added ADB Loader tools for RHEL 8

Added the ability to deploy maintenance scripts for several databases

Enabled the backlog_lock_waits GUC

Added the Delete PXF action

Implemented ADBCC 3.3.0

Moved the Disable firewall option to the cluster level from the ADB service

Wrong column binding was used to extract values from a SharedScan node

gptkh: the distributed table test2_tmp_3054 looked at itself

gptkh: an error in parsing settings for distributed tables

Coordinator did not use quote escaping for GUC values when restored on QE

The sshd option MaxStartups had to be added before Match

Built the docker-compose RPM package 1.29.2

Synced with upstream Greenplum Database 6.18.2

[6X backport] Implemented archive_mode always

[6X backport] Zero fill pages skipped by a force WAL switch

Added Kafka ADB connector 1.0.4

Added plcontainer 2.1.5

Implemented ADBCC 3.2.5

Power: an unexpected subplans order caused subselect_gp test fails

Implemented ADBCC 3.2.4

When accessing from an append-optimized table, Index returned the wrong result

kafka-fdw: fixed garbage in output at least for the text format

gpbackup handled an empty tables set for an incremental data backup properly

gpbackup hung forever after it was interrupted

Synced with upstream Greenplum Database 6.18.0

gpbackup: added an explicit order of tables by using pg_class.relpages

PXF: added the partitioning query support for Sybase

Implemented ADBCC 3.2.2

The SIGSEGV unexpected error on Reindex operation

madlib on ppc64le arch is now included into a build

gpbackup could dump the partitioned table data twice

The Not enough memory reserved for the statement error occurred when the PL/pgSQL function was called multiple times for CTE (Common Table Expression) SELECT statement against a table with a lot of partitions

Synced with upstream Greenplum Database 6.17.5

ADB bundle: added the Delete service action for Monitoring Clients

ADB bundle: added the Ready to upgrade status for a bundle upgrade action

Fixed low CPU performance on Power with newly added CGLAGS build options

Synced with upstream Greenplum Database 6.17.2

Synced with PXF 5.16.3

Synced with gpbackup 1.21.0

Synced with gpbackup-s3-plugin 1.7.0

Added a build for Power8 LE platform (ppc64le arch)

Implemented ADBCC 3.1.3

Synced with upstream Greenplum Database 6.17.1

Implemented the ZSTD compression support for gpbackup

adcc-extension: started to send a schema name in the Node message

ADB bundle: external database connection for ADBCC

Implemented ADBCC 3.1.0

kafka-fdw: segments failed after applying SELECT to a KafkaToADB external table with batch size more than 40000 - <msg_count> * 40 bytes (where <msg_count> is a count of messages)

PostgreSQL query optimizer built a bad plan for replicated tables with indexes

adcc-extension: the expected segment distributed transaction context was Segment Prepared

adcc-extension: there was no possibility to differ QueryStatus for slices executed on Master

Power: a bogus compiler error during pg_upgrade compilation

CVE-2020-25695

Synced with upstream Greenplum Database 6.16.3

[6X backport] POLLHUP/POLLRDHUP are now detected while queries are running

adcc-extension: started to retrieve and send an error text

ADB bundle: defined adjustable parameters for ADBCC

Implemented ADBCC 3.0.3

Fixed ERROR: header checksum does not match

[6X backport] Restricted execution for multi-level correlated queries

adcc-extension: security_barrier views

Synced with upstream Greenplum Database 6.16.2

[6X Backport] Shrinking of relation segment files to zero on TRUNCATE and DELETE

ADBCC: added JVM arguments for logging

PXF: removed the tuple count check for JDBC queries INSERT

gpbackup failed when foreign tables were present in the database since it tried to acquire a lock on a foreign table

Synced with upstream Greenplum Database 6.16.1

Implemented ADBCC 2.1.1

Kafka ADB Connector: allowed users to set custom librdkafka options

[6X backport] GPORCA fails with SIGSEGV on queries to view against a table with dropped columns

[6X backport] The elog function ignores multibyte encoding when it truncates a long message

ADB bundle: set a netcat timeout for sending monitoring metrics in AltLinux

The PartitionSelector mechanism did not return tuples in case of the type mismatch

adcc-extension: unknown node with id=5 for a subplan in values

adcc-extension: a locally planned mark was lost in node status messages for queries with custom aggregate

Wrong CCNTs for plans dispatched after InitPlans were executed

Removed redundant Gpmon_Incr_Rows_Out() calls in internal sort functions

An invalid variable specified in the segment directory path check in ADCM

Synced with upstream Greenplum Database 6.16.0

Added the gp_enable_gpperfmon=on parameter to Master and Segment servers for ADBCC

Implemented the diskquota extension update

Added the $PXF_CONF and the $PXF_HOME environment variables to PXF hosts

Kafka ADB connector: implemented signal handlers to interrupt consuming

Ported ADB to Alt Linux 8.2

[6X backport PR 11625] pg_rewind: avoided removing files from the log directory

Invalid values in the prodataaccess attribute of the pg_proc relation after the cluster initialization/upgrade

Kafka ADB connector did not consider partitions empty when a query for their watermark offsets failed after a timeout

[6X backport] GPORCA produced an incorrect plan for the NOT IN clause

Implemented ADBCC 2.0

A broken URL in the ADB bundle service description

Synced with upstream Greenplum Database 6.15.0

Implemented switchover from Master to Standby via ADCM

Kafka ADB connector: converting AVRO dates before UNIX epoch to the Greenplum Database representation

Kafka ADB connector: the Greenplum Database representation of AVRO double numbers that have more than 6 digits after a radix point

Kafka ADB connector: wrong interpretation for AVRO timestamps below zero

Synced with upstream Greenplum Database 6.14.1

Added a link to the home ADBCC page, which is activated when a logo is clicked

Removed online loading of static resources from the ADBCC web interface

Resource group waiting queue corruption

The pg_aocsseg inconsistency after the column addition rollback

A cluster failed after the single segment host lost due to the FTS misbehavior

A multiline text in the CSV output from gplogfilter was incorrect

Fixed incorrect links in repositories of the 6.14.0.13.b1 release

Synced with upstream Greenplum Database 6.14.0

Synced with upstream Greenplum Database 6.13.0

Supported auxiliary relations for append-optimized tables to be used by the pgstattuple extension to exactly estimate the bloat of those relations

Tkhemali-connector: avoided the intermediate conversion to a byte array

Removed the obsolete batching options in ADQM connector (since the TEXT is used now)

Reduced logging of gpstate

Greenplum Database failed after the developer GUCs of PostgreSQL being activated

GPORCA optimizer built inefficient query plans

Column-wise statistics target parameters did not apply to partitioning tables

Error with gpactivatestandby when running it too fast after the Master power off

Error in parsing decimal parts for time types

Scaling applied incorrectly to decimal values with a length less than a precision

Bumped to the latest version of additional components

Synced with upstream Greenplum Database 6.12.1

Added the offset function to Kafka connector

Added the rest committed function to Kafka ADB connector

Implemented the text format for Kafka ADB connector

Provided the JVM_OPTS setting for PXF

Supported AVRO logical types in Kafka ADB connector

Switched to the new way of postgis installation

Started to use rd_kafka_query_watermark_offsets to validate partition-offset pairs in Kafka ADB connector

ADBCC disk space usage troubles in case of core dumps

The missing data for column error in gprestore

The limit of distributed transactions has been reached error on Secondary Master

The WindowFunc with winref 1 assigned to WindowAgg with winref 2 (nodeWindowAgg.c:2264) error

Wrong behavior with a grouping function

An exclusive lock on any partitioned table locked the pg_partitions view

A server locked the kadb.offsets table