Arenadata Orchestrator
Arenadata Orchestrator (ADO) is a platform for setting up and operating data pipelines in a production environment. The central component of the platform is Apache Airflow, an open source tool used to programmatically create, schedule, and monitor process and task sequences (DAGs).
Software description and pricing information are available at Arenadata website — https://arenadata.tech/products/arenadata-orchestrator/.
TOP-10 popular articles
The article lists services included into the current version of ADO.
Arenadata Orchestrator software requirements for proper cluster installation.
The table with ADO service ports required for successful Arenadata Orchestrator installation.
An overview of Airflow concepts (DAG, task, operator) and Airflow architectural components (Web server, Metadata database, Scheduler, Executor, Worker).
The article describes the use of the dbt-greengage adapter, which allows the DBT service to interact with Greengage DB.
An overview of available performance tuning approaches for Airflow optimization in ADO with examples.
The article describes how to manage Python dependencies in Airflow via ADCM.
The article describes the DBT service — SQL-first transformation tool for building ELT pipelines.
This article presents an overview of the Airflow REST API.
Using HashiCorp Vault for secure management of sensitive data in Arenadata Orchestrator.