MapReduce CLI

All MapReduce commands are called by the bin/mapred script. Running the mapred script without any arguments prints the description for all commands.

The script usage is as follows:

$ mapred [SHELL_OPTIONS] COMMAND [GENERIC_OPTIONS] [COMMAND_OPTIONS]

Hadoop has an option parsing framework that employs parsing generic options as well as running classes.

MapReduce shell basic structure
Command options Description

SHELL_OPTIONS

The common set of shell options

GENERIC_OPTIONS

The common set of options supported by multiple commands

COMMAND_OPTIONS

Various commands with their options

User commands

Creates a Hadoop archive

Combines YARN logs into Hadoop archives

Prints the classpath

Used for inter/intra-cluster copying of large files and directories

Used to work with MapReduce jobs

Runs a pipe job

Allows to interact with queues and to view job queue information

Prints the version

Displays computed Hadoop environment variables

Administration commands

Starts JobHistoryServer

Runs a MapReduce HSAdmin client

Collects framework JARs

Found a mistake? Seleсt text and press Ctrl+Enter to report it