Arenadata Hyperwave
Arenadata Hyperwave (ADH) is a universal hybrid platform based on open-source components and proprietary developments, designed for storing, processing, and analyzing data of any structure and volume.
TOP-10 popular articles
A list of software requirements for ADH operation.
An overview of Apache Iceberg — an open-source table format for data lakes that enables ACID transactions, time travel, schema evolution, partition evolution, and other features.
The tables with Arenadata Hyperwave network requirements: ADH service ports, JMX ports, ports redefined by Kerberos, client ports.
The article shows how to create and run your first DAG to process CSV files.
An overview of HDFS (Hadoop Distributed File System) — a highly fault-tolerant distributed file system designed for deployment on low-cost hardware.
An article about the Airflow concepts (DAG, task, operator) and architectural components. Airflow is a platform that allows you to develop, plan, run, and monitor complex workflows.
An overview of SSM replication mechanism that can be used for synchronizing data in Hive Metastores (HMS) located in different ADH clusters. The article covers major replication concepts, describes the workflow, and provides a replication scenario.
A cheatsheet that describes the most common HDFS commands with examples.
An overview of Apache Ozone — a distributed key/value object storage optimized for working with both Hadoop services and S3 storages. Major components and concepts, read and write operations flow description.
An overview of the Kyuubi service — a distributed and multi-tenant JDBC interface for large-scale data processing and analytics.