Arenadata Orchestrator
Arenadata Orchestrator (ADO) is a platform for setting up and operating data pipelines in a production environment. The central component of the platform is Apache Airflow, an open source tool used to programmatically create, schedule, and monitor process and task sequences (DAGs).
Software description and pricing information are available at Arenadata website — https://arenadata.tech/products/arenadata-orchestrator/.
TOP-10 popular articles
An overview of Airflow concepts (DAG, task, operator) and Airflow architectural components (Web server, Metadata database, Scheduler, Executor, Worker).
The article describes the DBT service — SQL-first transformation tool for building ELT pipelines.
Arenadata Orchestrator software requirements for proper cluster installation.
The table with ADO service ports required for successful Arenadata Orchestrator installation.
The article lists services included into the current version of ADO.
Overview of the GitSync service, which is used for synchronizing Airflow DAGs with remote Git repositories.
This guide describes online installation of ADO using ADCM.
Overview of existing approaches to delivering the necessary clients to Airflow workers with examples.
The Airflow CLI jobs check command description, arguments, and usage examples.
An overview of available performance tuning approaches for Airflow optimization in ADO with examples.