|
||||||||||
| PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
| SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD | |||||||||
java.lang.Objectorg.apache.hadoop.conf.Configured
org.apache.hadoop.mapred.pipes.Submitter
public class Submitter
The main entry point and job submitter. It may either be used as a command line-based or API-based method to launch Pipes jobs.
| Field Summary | |
|---|---|
protected static org.apache.commons.logging.Log |
LOG
|
| Constructor Summary | |
|---|---|
Submitter()
|
|
Submitter(Configuration conf)
|
|
| Method Summary | |
|---|---|
static String |
getExecutable(JobConf conf)
Get the URI of the application's executable. |
static boolean |
getIsJavaMapper(JobConf conf)
Check whether the job is using a Java Mapper. |
static boolean |
getIsJavaRecordReader(JobConf conf)
Check whether the job is using a Java RecordReader |
static boolean |
getIsJavaRecordWriter(JobConf conf)
Will the reduce use a Java RecordWriter? |
static boolean |
getIsJavaReducer(JobConf conf)
Check whether the job is using a Java Reducer. |
static boolean |
getKeepCommandFile(JobConf conf)
Does the user want to keep the command file for debugging? If this is true, pipes will write a copy of the command data to a file in the task directory named "downlink.data", which may be used to run the C++ program under the debugger. |
static RunningJob |
jobSubmit(JobConf conf)
Submit a job to the Map-Reduce framework. |
static void |
main(String[] args)
Submit a pipes job based on the command line arguments. |
int |
run(String[] args)
Execute the command with the given arguments. |
static RunningJob |
runJob(JobConf conf)
Submit a job to the map/reduce cluster. |
static void |
setExecutable(JobConf conf,
String executable)
Set the URI for the application's executable. |
static void |
setIsJavaMapper(JobConf conf,
boolean value)
Set whether the Mapper is written in Java. |
static void |
setIsJavaRecordReader(JobConf conf,
boolean value)
Set whether the job is using a Java RecordReader. |
static void |
setIsJavaRecordWriter(JobConf conf,
boolean value)
Set whether the job will use a Java RecordWriter. |
static void |
setIsJavaReducer(JobConf conf,
boolean value)
Set whether the Reducer is written in Java. |
static void |
setKeepCommandFile(JobConf conf,
boolean keep)
Set whether to keep the command file for debugging |
static RunningJob |
submitJob(JobConf conf)
Deprecated. Use runJob(JobConf) |
| Methods inherited from class org.apache.hadoop.conf.Configured |
|---|
getConf, setConf |
| Methods inherited from class java.lang.Object |
|---|
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
| Methods inherited from interface org.apache.hadoop.conf.Configurable |
|---|
getConf, setConf |
| Field Detail |
|---|
protected static final org.apache.commons.logging.Log LOG
| Constructor Detail |
|---|
public Submitter()
public Submitter(Configuration conf)
| Method Detail |
|---|
public static String getExecutable(JobConf conf)
conf -
public static void setExecutable(JobConf conf,
String executable)
conf - executable - The URI of the application's executable.
public static void setIsJavaRecordReader(JobConf conf,
boolean value)
conf - the configuration to modifyvalue - the new valuepublic static boolean getIsJavaRecordReader(JobConf conf)
conf - the configuration to check
public static void setIsJavaMapper(JobConf conf,
boolean value)
conf - the configuration to modifyvalue - the new valuepublic static boolean getIsJavaMapper(JobConf conf)
conf - the configuration to check
public static void setIsJavaReducer(JobConf conf,
boolean value)
conf - the configuration to modifyvalue - the new valuepublic static boolean getIsJavaReducer(JobConf conf)
conf - the configuration to check
public static void setIsJavaRecordWriter(JobConf conf,
boolean value)
conf - the configuration to modifyvalue - the new value to setpublic static boolean getIsJavaRecordWriter(JobConf conf)
conf - the configuration to check
public static boolean getKeepCommandFile(JobConf conf)
conf - the configuration to check
public static void setKeepCommandFile(JobConf conf,
boolean keep)
conf - the configuration to modifykeep - the new value
@Deprecated
public static RunningJob submitJob(JobConf conf)
throws IOException
runJob(JobConf)
conf - the job to submit to the cluster (MODIFIED)
IOException
public static RunningJob runJob(JobConf conf)
throws IOException
conf - the job to submit to the cluster (MODIFIED)
IOException
public static RunningJob jobSubmit(JobConf conf)
throws IOException
RunningJob which can be used to track
the running-job.
conf - the job configuration.
RunningJob which can be used to track the
running-job.
IOException
public int run(String[] args)
throws Exception
Tool
run in interface Toolargs - command specific arguments.
Exception
public static void main(String[] args)
throws Exception
args -
Exception
|
||||||||||
| PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
| SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD | |||||||||