frameworkuploader
The command collects framework JARs and uploads them to HDFS as a tarball.
The usage is as follows:
$ mapred frameworkuploader -target <target> args
-input <classpath> |
The input classpath that is searched for JAR files to be included in the tarball |
-fs <filesystem> |
The target file system.
Defaults to the default filesystem set by |
-target <target> |
The target location to store the framework tarball, optionally followed by a |
-blacklist <list> |
Specifies a comma-separated array of regexps to filter JAR file names to exclude from the classpath. For example, this can be used to exclude test JARs or Hadoop services that are not necessary to localize |
-whitelist <list> |
Specifies a comma-separated array of regexps to include specific JAR files. This can be used to provide additional security, so that no external source can include malicious code in the classpath when the tool runs |
-nosymlink |
Used to exclude symlinks that point to the same directory. For example, the path /a/foo.jar and a symlink /a/bar.jar that points to /a/foo.jar would normally add foo.jar and bar.jar to the tarball as separate files despite them actually being the same file. This flag would make the tool exclude /a/bar.jar so only one copy of the file is added |
-initialReplication <num> |
The replication number that is used to create the framework tarball.
It is safe to leave this value as the default |
-finalReplication <num> |
The uploader tool sets the replication factor once all blocks are collected and uploaded.
If a quick initial startup is required, then it is recommended to set this value equal to the number of commissioned nodes divided by two but less than |
-acceptableReplication <num> |
The tool waits until the tarball gets replicated by this number of times before exiting.
The value should be a replication number less than or equal to the value of |
-timeout <seconds> |
A timeout to wait to reach |
Example:
$ mapred frameworkuploader -timeout 10