Arenadata Orchestrator
Arenadata Orchestrator (ADO) is a platform for setting up and operating data pipelines in a production environment. The central component of the platform is Apache Airflow, an open source tool used to programmatically create, schedule, and monitor process and task sequences (DAGs).
Software description and pricing information are available at Arenadata website — https://arenadata.tech/products/arenadata-orchestrator/.
TOP-10 popular articles
The article lists services included into the current version of ADO.
An overview of Airflow concepts (DAG, task, operator) and Airflow architectural components (Web server, Metadata database, Scheduler, Executor, Worker).
This article presents an overview of the Airflow REST API.
The article describes the DBT service — SQL-first transformation tool for building ELT pipelines.
Overview of existing approaches to delivering the necessary clients to Airflow workers with examples.
The table with ADO service ports required for successful Arenadata Orchestrator installation.
The Airflow CLI jobs check command description, arguments, and usage examples.
The article describes the Airflow web interfaces.
Arenadata Orchestrator software requirements for proper cluster installation.
The article shows how to create and run your first DAG to process CSV files.