|
||||||||||
| PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
| SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD | |||||||||
java.lang.Objectorg.apache.hadoop.mapreduce.InputFormat<K,V>
org.apache.hadoop.mapreduce.lib.input.DelegatingInputFormat<K,V>
@InterfaceAudience.Private @InterfaceStability.Unstable public class DelegatingInputFormat<K,V>
An InputFormat that delegates behavior of paths to multiple other
InputFormats.
MultipleInputs.addInputPath(Job, Path, Class, Class)| Constructor Summary | |
|---|---|
DelegatingInputFormat()
|
|
| Method Summary | |
|---|---|
RecordReader<K,V> |
createRecordReader(InputSplit split,
TaskAttemptContext context)
Create a record reader for a given split. |
List<InputSplit> |
getSplits(JobContext job)
Logically split the set of input files for the job. |
| Methods inherited from class java.lang.Object |
|---|
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
| Constructor Detail |
|---|
public DelegatingInputFormat()
| Method Detail |
|---|
public List<InputSplit> getSplits(JobContext job)
throws IOException,
InterruptedException
InputFormatEach InputSplit is then assigned to an individual Mapper
for processing.
Note: The split is a logical split of the inputs and the
input files are not physically split into chunks. For e.g. a split could
be <input-file-path, start, offset> tuple. The InputFormat
also creates the RecordReader to read the InputSplit.
getSplits in class InputFormat<K,V>job - job configuration.
InputSplits for the job.
IOException
InterruptedException
public RecordReader<K,V> createRecordReader(InputSplit split,
TaskAttemptContext context)
throws IOException,
InterruptedException
InputFormatRecordReader.initialize(InputSplit, TaskAttemptContext) before
the split is used.
createRecordReader in class InputFormat<K,V>split - the split to be readcontext - the information about the task
IOException
InterruptedException
|
||||||||||
| PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
| SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD | |||||||||