Arenadata Documentation
Our passion is to build efficient flexible solutions that scale up to dozens of petabytes
ADB
ADH
ADQM
ADS
ADPG
ADCM
ADPS
Showing results: 5 of 16. See all results...
Products
Explore our range of solutions in the world of Big Data

Arenadata QuickMarts

Arenadata QuickMarts (ADQM) is a hight-performance DMBS for online analytical processing (OLAP). It is feature-rich, linearly scalable, fault tolerant, and reliable. It can be used in various fields like:
  • quick data marts;
  • e-commerce and finance;
  • monitoring and analysis of structured logs and events;
  • time series data;
  • web and mobile application analytics.
Use cases
Advanced data analytics

A successful architectural pattern is to use Arenadata QuickMarts as a layer for fast data analysis. In this paradigm, an OLTP database is used to record transactional data into its row-based model, and Arenadata QuickMarts serves advanced analytical queries leveraging its column-oriented model to answer complex aggregates on the millisecond scale.

Additionally, Arenadata QuickMarts provides a wide range of engines to store and process data, as well as a rich toolkit of built-in functions for fast data analysis.

Artificial intelligence

Arenadata QuickMarts is great as a data source for machine learning algorithms. It can be integrated with open-source Yandex CatBoost algorithm. Some of the main features of this competitive library are: default parameters (without customization) provide great results, categorical features do not require preprocessing, quick computation, high accuracy without overfitting, and lastly, efficient predictions.

E-commerce and finance

Arenadata QuickMarts is an excellent choice for quick storing e-commerce data such as business transactions, user behavior and advertising data, and building flexible BI reports on top of it.

Time series

Arenadata QuickMarts is optimized for storing and querying time series data. It’s a good choice for analyzing data from financial markets or IoT devices.

Log analytics

Arenadata QuickMarts is a good choice to collect log data from different sources for further analysis. Fast query execution provides an easy-to-use interface for collecting facts, gathering metrics, or building event processing on top of it.

Enterprise
Community
Core ClickHouse functionality
Chproxy proxy server
ClickHouse Connector
Apache ZooKeeper as coordinator
ClickHouse Keeper as coordinator
Monitoring
JDBC Bridge
Offline installation
Deploy & upgrade automation
x86
Technical support 24/7
Corporate training courses
Tailored solutions
Available integrations
ADPG
ADPG
Two-way data exchange with Arenadata Postgres (ADPG) is available via the PostgreSQL table engine, PostgreSQL database engine, or table function.
ADH
ADH
Allows read/write files in HDFS via the built-in table function or corresponding table engine.
ADB
ADB
ADB ClickHouse connector provides the possibility of high-speed, parallel data exchange between Arenadata DB (ADB) and ADQM.
ADS
ADS
Built-in Kafka table engine allows reading streaming data from Kafka servers.
PostgreSQL
PostgreSQL
Two-way data exchange with PostgreSQL is available via the PostgreSQL table engine, PostgreSQL database engine, or table function.
Kafka
Kafka
Built-in Kafka table engine allows reading streaming data from Kafka topics.
MySQL
MySQL
Two-way data exchange with MySQL is available via the MySQL table engine, MySQL database engine, or table function.
HDFS
HDFS
Allows read/write files in HDFS via the built-in table function or corresponding table engine.
Hive
Hive
Allows reading data from Hive using the built-in Hive table engine.
Greenplum
Greenplum
ADB ClickHouse connector provides the possibility of high-speed, parallel data exchange between Arenadata DB (ADB) and ADQM.
JDBC
JDBC
Two-way data exchange with JDBC data sources is available via JDBC Bridge.
ODBC
ODBC
Two-way data exchange with ODBC data sources is available via ODBC Bridge.
S3
S3
Two-way data exchange with an S3 storage is available through the built-in table function or the corresponding table engine.
Operating systems
Alt Linux
Alt Linux 8 SP is supported
CentOS
CentOS 7 is supported
RedHat
RedHat 7 is supported
Astra Linux
Astra Linux SE 1.7 Orel is supported
Core ClickHouse functionality
Chproxy proxy server
ClickHouse Connector
Apache ZooKeeper as coordinator
ClickHouse Keeper as coordinator
Monitoring
JDBC Bridge
Offline installation
Deploy & upgrade automation
x86
Technical support 24/7
Corporate training courses
Tailored solutions
Available integrations
ADPG
ADPG
Two-way data exchange with Arenadata Postgres (ADPG) is available via the PostgreSQL table engine, PostgreSQL database engine, or table function.
ADH
ADH
Available only for Enterprise
ADB
ADB
Available only for Enterprise
ADS
ADS
Built-in Kafka table engine allows reading streaming data from Kafka servers.
PostgreSQL
PostgreSQL
Two-way data exchange with PostgreSQL is available via the PostgreSQL table engine, PostgreSQL database engine, or table function.
Kafka
Kafka
Built-in Kafka table engine allows reading streaming data from Kafka topics.
MySQL
MySQL
Two-way data exchange with MySQL is available via the MySQL table engine, MySQL database engine, or table function.
HDFS
HDFS
Allows read/write files in HDFS via the built-in table function or corresponding table engine.
Hive
Hive
Allows reading data from Hive using the built-in Hive table engine.
Greenplum
Greenplum
ADB ClickHouse connector provides the possibility of high-speed, parallel data exchange between Arenadata DB (ADB) and ADQM.
JDBC
JDBC
Two-way data exchange with JDBC data sources is available via JDBC Bridge.
ODBC
ODBC
Two-way data exchange with ODBC data sources is available via ODBC Bridge.
S3
S3
Two-way data exchange with an S3 storage is available through the built-in table function or the corresponding table engine.
Operating systems
Alt Linux
Available only for Enterprise
CentOS
CentOS 7 is supported
RedHat
RedHat 7 is supported
Astra Linux
Available only for Enterprise
Features
High performance
Execution of large queries is naturally parallelized and the vector computation engine allows achieving high CPU utilisation
Feature-rich
Arenadata QuickMarts has many built-in analytical functions to produce complex reports ready to use by Business Intelligence tools
Linear scalability
Large data is distributed among multiple shards of a cluster
Fault tolerance
Asynchronous multi-master replication makes Arenadata QuickMarts highly reliable and flexible for different types of workloads
Data compression
One of the most important aspects for column-oriented DBMS to achieve high performance
User account management
RBAC-based access control management system with SQL-driven interface
Row policy
Control data availability – assign policies to users/roles and provide fine-grained access to the data
Quota limits
Limit resource usage over a period of time or track the use of resources
Connected products
ADB ClickHouse Connector
The service provides the ability to export data from Arenadata DB to ClickHouse/ADQM with INSERT queries.
The solution supports several options to distribute the load between ClickHouse/ADQM nodes, transaction-like insertion through intermediate tables, and direct insertion into target tables.
It is possible to use Distributed tables to:
  • support a strategy for distributing data across physical tables;
  • increase insertion speed;
  • balance load on ClickHouse/ADQM nodes.
Read documentation
ADQM Spark Connector
Multifunctional connector with support for parallel read/write operations between Apache Spark and Arenadata QuickMarts.
It has great flexibility in configuration and a multitude of features, including:
  • high speed of data transmission;
  • automatic data schema generation;
  • flexible partitioning;
  • support for push-down operators;
  • support for batch operations.
Read documentation
JDBC Bridge
The service provides the ability to pass queries to external data sources that support the JDBC interface.
Interaction is possible through JDBC table functions or JDBC table engine.
The solution provides:
  • connection pooling;
  • load balancing and fail-over;
  • limited support for modifying data in a source (INSERT) and support for scripts.
Chproxy HTTP-proxy & load-balancer
The service implements a load balancer and an HTTP proxy server when users interact with ClickHouse/ADQM.
It supports the HTTP and HTTPS protocols and can:
  • limit HTTP access by a list of allowed IP addresses/IP masks;
  • authorize users safely – Chproxy can map users submitting requests to users of the ADQM cluster without exposing real usernames and passwords used in ADQM;
  • check health of cluster nodes and prevent requests from being sent to unavailable nodes.
Product comparison

Compare with

Compare with

Infrastructure
Management system
Arenadata Cluster Manager (ADCM)

A single tool for managing the lifecycle of all Arenadata products.

ADCM is installed with one command and only requires Docker.

Vertica Management console

Management console Cluster, node, backup, and update management.

User management.

AWS Console

AWS product management via a web interface.

Region and cluster size selection.

Monitoring management.

Snowsight

Automated deployment and configuration.

Allows cluster management.

User, role, and resource management.

Azure

Azure cloud web interface.

Resource and volume management.

Ability to build dashboards based on data.

ClickHouse cloud

Web interface with the ability to manage backups and monitoring.

System monitoring
Yes
Yes
Yes
Yes
Yes
Yes
Centralized upgrade
Yes
Yes
Serverless
Serverless
Serverless
Serverless
Ability to deploy various combinations of bare metal, cloud
Yes
Yes
No
No
No
No
Cloud support
Google Cloud Platform
Yes
Yes
No
Yes
No
Yes
Yandex
Yes
No
No
No
No
No
VK Cloud
No
No
No
No
No
No
Sber
Yes
No
No
No
No
No
Azure
No
Yes
No
Yes
Yes
No
AWS
No
Yes
Yes
Yes
No
Yes
Operating system support
Alt Linux
Yes
No
Not relevant
Not relevant
Not relevant
Not relevant
Astra Linux
Yes
No
Not relevant
Not relevant
Not relevant
Not relevant
CentOS
Yes
Yes
Not relevant
Not relevant
Not relevant
Not relevant
RedHat
Yes
Yes
Not relevant
Not relevant
Not relevant
Not relevant
Ubuntu
No
Yes
Not relevant
Not relevant
Not relevant
Not relevant
Features
Query monitoring
No
Yes
Possible performance degradation.
Yes
Yes
Yes
Yes
Transactions
No
ETL provision.
Yes
Yes
Yes
Yes
No
ETL provision.
External tables
Yes
Yes
Possible performance degradation.
Yes
No
Yes
Yes
Backup
No
Yes
Yes
Yes
Yes
Yes
Priority way of obtaining data
RT
Batch
Batch
Batch
Batch
Batch
RT
Batch
Node fault tolerance
No
Product management options are limited.
Yes
Yes
AWS S3 Recovery.
Yes
Yes
Yes
DC fault tolerance
No
Product management options are limited.
No
Yes
AWS Cloud.
Yes
Yes
Azure Cloud.
Yes
ML functions
Yes
Yes
Yes
AWS SageMaker.
No
Yes
Azure ML.
Yes
Integrations
Kafka
Yes
Yes
Possible performance degradation.
Yes
Possible performance degradation.
Yes
Possible performance degradation.
Yes
Possible performance degradation.
Yes
HDFS
Yes
Yes
Yes
AWS Glue.
No
Yes
Azure Data Lake Store.
Yes
Greenplum
Yes
No
No
No
No
Yes
S3
Yes
Yes
Yes
Yes
Yes
Yes
ODBC
Yes
Yes
Yes
Yes
Yes
Yes
JDBC
Yes
Yes
Yes
Yes
Yes
Yes
Integration with BI systems
Superset
Yes
Yes
Possible performance degradation.
Yes
Possible performance degradation.
Yes
Possible performance degradation.
Yes
Possible performance degradation.
Yes
PowerBI
Yes
Yes
Possible performance degradation.
Yes
Possible performance degradation.
Yes
Possible performance degradation.
Yes
Yes
Security settings
SSL encryption
Yes
Yes
No
Yes
Yes
Yes
LDAP
Yes
Yes
No
No
No
Azure cloud.
Yes
Additionally
Technical support 24/7
Yes
Not available for Russia
Not available for Russia
Not available for Russia
Not available for Russia
Not available for Russia
Training/workshops
Yes
Full training on working with Arenadata products
Not available in Russian language
Not available in Russian language
Not available in Russian language
Not available in Russian language
Not available in Russian language
Community version
Yes
No
No
No
No
No
Open-source version
Documentation
Yes

Detailed documentation in Russian and English languages for all services, their installation, configuration, and operation.

Available in the public domain.

Yes
Detailed documentation in English language.
Yes
Detailed documentation in English language.
Yes
Detailed documentation in English language.
Yes
Detailed documentation in English language.
Yes
Detailed documentation in English and Russian language.
Registration in the register of domestic software
Yes
No
No
No
No
No
Release history with descriptions
Yes
Complete release history with service versions and description of the upgraded functionality is available in the open domain.
Yes
In English language.
Yes
In English language.
Yes
In English language.
Yes
In English language.
Yes
In English language.

“Product comparison” section is relevant on the date of 30.06.2023.

Releases
2023
ADQM 23.8.2.7.1
  • Increased ClickHouse version
  • Increased ZooKeeper version
  • Introduced the Prometheus-based monitoring service
  • Introduced new Grafana dashboards
  • Added the jdbc bridge log path setting
  • Implemented CA certificate support for inter-server communications
  • ClickHouse errors are now displayed in ADQM jobs
Read more
ADQM 23.3.2.37
  • Increased ClickHouse version to 23.3.2.37-lts
  • Implemented support for the gRPC network interface
  • Extended data storage configuration options
  • Added new sections to the configuration page of the ADQMDB service instead of the Storage Configuration parameter
  • Implemented the ability to define requirements for the complexity of user passwords
  • Added the Encryption codecs for tables section
Read more
ADQM 22.8.12.45
  • Increased ClickHouse version to 22.8.12.45-lts
  • Added support for Astra Linux
  • Added support of Kerberos authentication
  • Implemented support for SSL in the Chproxy service
  • Implemented the ability to install ClickHouse Keeper as a separate service
Read more
ADQM 22.8.6.71
  • Implemented a set of improvements to increase the security at the level of interaction between cluster hosts, SSL support, Chproxy and ClickHouse interaction
  • Refactored the Configuration page of the ADQMDB service in the ADCM interface: improved descriptions of some parameters, deleted the external_dictionaries_path and external_dictionaries parameters from the Other section, and moved the Other section to the end of the page
  • Extended a set of pre-checks before an ADQM cluster installation
Read more
ADQM 22.8.4.7
  • Implemented the concurrent_threads_soft_limit parameter that allows you to limit the number of query processing threads
  • Added the Disable SElinux and Disable Firewalld options to the cluster configuration page in the ADCM interface
  • Excluded the Baje proxy service from ADQM
  • Added Alt Linux version check before installing ADQM
Read more
ADQM 22.3.7.28
  • Added the Chproxy service
  • Fixed an error occurred when upgrading ADQM on Alt Linux
  • Fixed incorrect switching of a cluster status from upgradable to installed during the cluster upgrade
  • Changed ADQM package names so that they differ from names of ClickHouse packages
Read more
ADQM 22.3.2.2
  • Increased ClickHouse version to 22.3.2.2-lts
  • Added support for Alt Linux 8.4 SP
  • Added the ClickHouse Keeper component
  • Expanded management options for built-in logging tools
  • Added checks of monitoring services installed in an Enterprise Tools cluster before importing monitoring settings into an ADQM cluster
Read more
ADQM 21.8.13.6
  • Fixed: ADQM bundle upgrade could lead to loss of cluster configuration data if the Default cluster topology field was set to an incorrect cluster topology (for example, shards and/or replicas were unsorted or a shard/replica identifier contained a space)
  • Implemented the Reinstall status-checker action for a cluster in the installed state. It runs the status-checker deployment scripts for services as well as for Docker containers
  • Added the Advanced configuration parameters section to the Configuration page of the ADQMDB service
  • Fixed the Baje proxy service installation error
Read more
ADQM 21.8.8.29
  • Fixed an error with offline installation of the ZooKeeper package
  • Increased ClickHouse version to 21.8.8.29-lts
  • Added the ability to map roles from an LDAP directory to ADQM roles and assign these roles to authenticated users
Read more
ADQM 21.3.14.1
  • Implemented the Expand and Shrink actions for the Monitoring Clients service
  • Added support for Alt Linux 8.2
  • Added retries to check JDBC bridge
  • Changed the logic of adding the log_queries parameter to the default settings profile in the users.xml file
Read more
ADQM 21.3.12.2
  • Added support for RHEL
  • Included checking of component versions to the Check action
  • Fixed an issue with importing the HTTP Mirror service of an Enterprise Tools cluster into an ADQM cluster
Read more
ADQM 21.3.11.5
  • Increased ClickHouse version to 21.3.11.5
Read more
ADQM 21.3.4.25
  • Increased ClickHouse version to 21.3.4.25-lts
  • Implemented the ability to install ADQM without Internet access
  • Fixed a Zookeeper service error occurred when performing the Expand action
  • Fixed an issue with skipping ADQMDB dashboards when installing monitoring
  • Fixed an issue with loading more than one Avro-formatted message from Kafka into a ClickHouse table
Read more
ADQM 20.8.13.15
  • Increased ClickHouse version to 20.8.13.15-lts
  • Implemented the ability to use an LDAP server for user authentication
  • Added Zookeeper check after installation
  • Fixed an issue with installing an ADQM cluster when using the external ZooKeeper
Read more
ADQM 20.8.11.17
  • Fixed an error in the users.xml file: the same IP address was duplicated in the networks list
  • Increased ClickHouse version to 20.8.11.17-lts
  • Added parameters to configure a default user and a default settings profile
  • Implemented creation of macros for multiple cluster topologies
  • Deleted the Create user and Delete users buttons
Read more
ADQM 20.8.4.11
  • Increased ClickHouse version to 20.8.4.11-lts
Read more
ADQM 20.3.20.6
  • Increased ClickHouse version to 20.3.20.6-lts
Read more
ADQM 20.8.2.3
  • Increased ClickHouse version to 20.8.2.3-stable
  • Added the ability to specify Kafka configuration parameters
Read more
ADQM 20.3.13.130
  • Increased ClickHouse version to 20.3.13.130-lts
  • Added the following parameters to the Configuration page of the ADQMDB service in the ADCM interface: Cluster Configuration, Storage Configuration, User policy, query_log
  • Added the ability to specify a username and password for replicas in the remote_servers section of the config.xml configuration file
Read more
ADQM 20.3.10.75
  • Fixed: incorrect minimum version for an upgrade
  • Increased ClickHouse version to 20.3.10.75
  • Fixed Zookeeper service check error occured when performing the Check action for a cluster
Read more
ADQM 19.14.11.16
  • Refactored the ADQM bundle
  • Increased ClickHouse version to 19.14.11.16-lts
  • Added support for Alt Linux
  • Divided the ADQM bundle into the Community and Enterprise versions
  • Updated EULA for the Community version
  • Added a window to sign the license agreement after downloading the bundle
  • Added the Clickhouse JDBC Bridge component to the ADQMDB service
  • Implemented the ability to use an external ZooKeeper
Read more