Spark3 service management via ADCM
The ADCM UI provides actions to manage the Spark3 service and its components. For information on how to run service actions, refer to ADH service actions.
The actions available for the Spark3 service are listed in the table below.
Action | Description |
---|---|
Check |
Runs service-specific tests to check the health of the service and its components |
Start |
Starts the service.
When you run this action, the option Apply configs from ADCM is available.
If it is set to |
Stop |
Stops the service |
Restart |
Restarts the service.
When you run this action, the option Apply configs from ADCM is available.
If it is set to |
Remove |
Removes the service from the cluster. This action should be used to remove already installed services. Whereas the control can be used to remove a non-mapped service (a service which components have not been distributed among cluster hosts) |
Add Client(s) |
Adds Spark3 client(s) to the cluster. Running this action opens the component-host mapping interface where you can add new Spark3 clients |
Remove Client(s) |
Removes Spark3 client(s) from cluster hosts. Running this action opens the component-host mapping interface where you can remove Spark3 clients from specific hosts |
Add Spark3 Connect |
Adds the Spark3 Connect component. Running this action opens the component-host mapping interface where you can add new Spark3 Connect components |
Remove Spark3 Connect |
Removes the Spark3 Connect component. Running this action opens the component-host mapping interface where you can remove Spark3 Connect components |
Add Spark3 History Server |
Adds the Spark3 History Server component. Running this action opens the component-host mapping interface where you can add new History Server components |
Move Spark3 History Server |
Moves the Spark3 History Server component to a different host. Use the force option if the source host (where the component is currently installed) is offline |
Remove Spark3 History Server |
Removes the Spark3 History Server component. Running this action opens the component-host mapping interface where you can remove History Server components |
Add Spark3 Livy |
Adds the Spark3 Livy Server component. Running this action opens the component-host mapping interface where you can add new Livy Server components |
Move Spark3 Livy |
Moves the Spark3 Livy Server component to a different host. Use the force option if the source host (where the service is currently installed) is offline |
Remove Spark3 Livy |
Removes the Spark3 Livy Server component. Running this action opens the component-host mapping interface where you can remove Livy Server components |
Manage Ranger plugin |
Enables/disables the Spark3 Ranger plugin |
Enables/disables dynamic resource allocation for Spark3 |
|
Add Spark3 ThriftServer |
Adds the Spark3 ThriftServer component. Running this action opens the component-host mapping interface where you can add new ThriftServer components |
Remove Spark3 ThriftServer |
Removes the Spark3 ThriftServer component. Running this action opens the component-host mapping interface where you can remove ThriftServer components |