worker

Definition

Starts a Celery worker node. You can run this command by using the Add/Remove components action in ADCM.

Usage

$ airflow celery worker [-h] [-a AUTOSCALE] [-H CELERY_HOSTNAME]
                      [-c CONCURRENCY] [-D] [-l LOG_FILE] [--pid [PID]]
                      [-q QUEUES] [-s] [--stderr STDERR] [--stdout STDOUT]
                      [-u UMASK] [-v] [--without-gossip] [--without-mingle]

Arguments

Parameter Description

-a, --autoscale

Minimum and maximum number of workers to autoscale

-H, --celery-hostname

Hostname of Celery worker if you have multiple workers on a single machine

-c, --concurrency

The number of worker processes. Default: 16

-D, --daemon

Run as a daemon instead of running in the foreground. Default: False

-l, --log-file

Location of the log file

--pid

PID file location

-q, --queues

Comma delimited list of queues to serve. Default: default

-s, --skip-serve-logs

Do not start the serve logs process along with the workers. Default: False

--stderr

Redirect stderr to this file

--stdout

Redirect stdout to this file

-u, --umask

Set the umask of Celery worker in daemon mode

--without-gossip

Do not subscribe to other workers events. Default: False

--without-mingle

Do not synchronize with other workers at start-up. Default: False

-h, --help

Print out the help manual for this command

-v, --verbose

Make logging output more verbose

Found a mistake? Seleсt text and press Ctrl+Enter to report it