MapReduce CLI

All MapReduce commands are called by the bin/mapred script. Running the mapred script without any arguments prints the description for all commands.

The script usage is as follows:

$ mapred [SHELL_OPTIONS] COMMAND [GENERIC_OPTIONS] [COMMAND_OPTIONS]

Hadoop has an option parsing framework that employs parsing generic options as well as running classes.

MapReduce shell basic structure
Command options Description

SHELL_OPTIONS

The common set of shell options

GENERIC_OPTIONS

The common set of options supported by multiple commands

COMMAND_OPTIONS

Various commands with their options

User commands

Command Description

archive

Creates a Hadoop archive

archives-logs

Combines YARN logs into Hadoop archives

classpath

Prints the classpath

distcp

Used for inter/intra-cluster copying of large files and directories

job

Used to work with MapReduce jobs

pipes

Runs a pipe job

queue

Allows users to interact with queues and to view job queue information

version

Prints the version

envvars

Displays computed Hadoop environment variables

Administration commands

Command Description

historyserver

Starts JobHistoryServer

hsadmin

Runs a MapReduce HSAdmin client

frameworkuploader

Collects framework JARs

Found a mistake? Seleсt text and press Ctrl+Enter to report it