public class HadoopExecutableManager extends ExecutableManager
HadoopExecutableManager is a specialization of
ExecutableManager and provides HDFS-specific support for secondary
outputs, task-logs etc.
HadoopExecutableManager provides support for secondary outputs
of the managed process and also persists the logs of the tasks on HDFS.command, exitCode, inputBytes, inputRecords, outerrThreadsError, outputBytes, outputRecords, stdin| Constructor and Description |
|---|
HadoopExecutableManager() |
| Modifier and Type | Method and Description |
|---|---|
void |
close()
Close and cleanup the
ExecutableManager. |
void |
configure(POStream stream)
Configure and initialize the
ExecutableManager. |
protected void |
exec()
Start execution of the external process.
|
protected void |
processError(String error)
Workhorse to process the stderr stream of the managed process.
|
protected boolean |
writeErrorToHDFS(int limit,
String taskId)
Should the stderr data of this task be persisted on HDFS?
|
runpublic void configure(POStream stream) throws IOException, ExecException
ExecutableManagerExecutableManager.configure in class ExecutableManagerstream - POStream operatorIOExceptionExecExceptionprotected void exec()
throws IOException
ExecutableManagerstderr of
the managed process.exec in class ExecutableManagerIOExceptionpublic void close()
throws IOException
ExecutableManagerExecutableManager.close in class ExecutableManagerIOExceptionprotected boolean writeErrorToHDFS(int limit,
String taskId)
limit - maximum number of tasks whose stderr log-files are persistedtaskId - id of the tasktrue if stderr data of task should be persisted on
HDFS, false otherwiseprotected void processError(String error)
ExecutableManagerExecuatbleManager just sends out the received
error message to the stderr of itself.processError in class ExecutableManagererror - error message from the managed process.Copyright © 2007-2017 The Apache Software Foundation