Spark service management via ADCM

Konstantin Alpashkin

The ADCM UI provides actions to manage the Spark service and its components. For information on how to run service actions, refer to ADH service actions.

The actions available for the Spark service are listed in the table below.

Action Description

Check

Runs service-specific tests to check the health of the service and its components

Start

Starts the service. When you run this action, the option Apply configs from ADCM is available. If it is set to true, all service configurations defined in ADCM settings will be applied on the service startup. Otherwise, the service starts without applying configurations from ADCM

Stop

Stops the service

Restart

Restarts the service. When you run this action, the option Apply configs from ADCM is available. If it is set to true, all service configurations defined in ADCM settings will be applied during the service restart. Otherwise, the service restarts without applying configurations from ADCM

Remove

Removes the service from the cluster. This action should be used to remove already installed services. Whereas the delete control can be used to remove a non-mapped service (a service which components have not been distributed among cluster hosts)

Add Client(s)

Adds Spark client(s) to the cluster. Running this action opens the component-host mapping interface where you can add new Spark clients

Remove Client(s)

Removes Spark client(s) from cluster hosts. Running this action opens the component-host mapping interface where you can remove Spark clients from specific hosts

Add Spark History Server

Adds the Spark History Server component. Running this action opens the component-host mapping interface where you can add new History Server components

Move Spark History Server

Moves the Spark History Server component to a different host. Use the force option if the source host (where the service is currently installed) is offline

Remove Spark History Server

Removes the Spark History Server component. Running this action opens the component-host mapping interface where you can remove History Server components

Move Spark Livy

Moves the Spark Livy Server component to a different host. Use the force option if the source host (where the component is currently installed) is offline

Switch dynamic allocation

Enables/disables dynamic resource allocation for Spark

Add Spark ThriftServer

Adds the Spark ThriftServer component. Running this action opens the component-host mapping interface where you can add new ThriftServer components

Remove Spark ThriftServer

Removes the Spark ThriftServer component. Running this action opens the component-host mapping interface where you can remove ThriftServer components
Found a mistake? Seleсt text and press Ctrl+Enter to report it