Arenadata Hyperwave

Arenadata Hyperwave (ADH) is a universal hybrid platform based on open-source components and proprietary developments, designed for storing, processing, and analyzing data of any structure and volume.

TOP-10 popular articles

An overview of Apache Ozone — a distributed key/value object storage optimized for working with both Hadoop services and S3 storages. Major components and concepts, read and write operations flow description.

An overview of HDFS (Hadoop Distributed File System) — a highly fault-tolerant distributed file system designed for deployment on low-cost hardware.

A cheatsheet that describes the most common HDFS commands with examples.

A list of software requirements for ADH operation.

An article about the Airflow concepts (DAG, task, operator) and architectural components. Airflow is a platform that allows you to develop, plan, run, and monitor complex workflows.

The tables with Arenadata Hyperwave network requirements: ADH service ports, JMX ports, ports redefined by Kerberos, client ports.

A list of network ports used by ADH services and components.

An overview of the Trino service, which is an SQL query engine used for processing data in parallel, distributed over multiple storages, such as object storages, databases, and file systems.

Hive execution plan analysis using the EXPLAIN and ANALYZE commands.

A description of the built-in Trino catalog for working with Iceberg tables. This catalog uses the Iceberg connector and is ready to work with Iceberg tables stored in your ADH cluster.

Found a mistake? Seleсt text and press Ctrl+Enter to report it