|
||||||||||
| PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
| SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD | |||||||||
java.lang.Objectorg.apache.hadoop.mapreduce.OutputFormat<K,V>
org.apache.hadoop.mapreduce.lib.output.FileOutputFormat<K,V>
org.apache.hadoop.mapreduce.lib.output.SequenceFileOutputFormat<BytesWritable,BytesWritable>
org.apache.hadoop.mapreduce.lib.output.SequenceFileAsBinaryOutputFormat
@InterfaceAudience.Public @InterfaceStability.Stable public class SequenceFileAsBinaryOutputFormat
An OutputFormat that writes keys,
values to SequenceFiles in binary(raw) format
| Nested Class Summary | |
|---|---|
static class |
SequenceFileAsBinaryOutputFormat.WritableValueBytes
Inner class used for appendRaw |
| Nested classes/interfaces inherited from class org.apache.hadoop.mapreduce.lib.output.FileOutputFormat |
|---|
FileOutputFormat.Counter |
| Field Summary | |
|---|---|
static String |
KEY_CLASS
|
static String |
VALUE_CLASS
|
| Fields inherited from class org.apache.hadoop.mapreduce.lib.output.FileOutputFormat |
|---|
BASE_OUTPUT_NAME, PART |
| Constructor Summary | |
|---|---|
SequenceFileAsBinaryOutputFormat()
|
|
| Method Summary | |
|---|---|
void |
checkOutputSpecs(JobContext job)
Check for validity of the output-specification for the job. |
RecordWriter<BytesWritable,BytesWritable> |
getRecordWriter(TaskAttemptContext context)
Get the RecordWriter for the given task. |
static Class<? extends WritableComparable> |
getSequenceFileOutputKeyClass(JobContext job)
Get the key class for the SequenceFile |
static Class<? extends Writable> |
getSequenceFileOutputValueClass(JobContext job)
Get the value class for the SequenceFile |
protected SequenceFile.Writer |
getSequenceWriter(TaskAttemptContext context,
Class<?> keyClass,
Class<?> valueClass)
|
static void |
setSequenceFileOutputKeyClass(Job job,
Class<?> theClass)
Set the key class for the SequenceFile |
static void |
setSequenceFileOutputValueClass(Job job,
Class<?> theClass)
Set the value class for the SequenceFile |
| Methods inherited from class org.apache.hadoop.mapreduce.lib.output.SequenceFileOutputFormat |
|---|
getOutputCompressionType, setOutputCompressionType |
| Methods inherited from class org.apache.hadoop.mapreduce.lib.output.FileOutputFormat |
|---|
getCompressOutput, getDefaultWorkFile, getOutputCommitter, getOutputCompressorClass, getOutputName, getOutputPath, getPathForWorkFile, getUniqueFile, getWorkOutputPath, setCompressOutput, setOutputCompressorClass, setOutputName, setOutputPath |
| Methods inherited from class java.lang.Object |
|---|
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
| Field Detail |
|---|
public static String KEY_CLASS
public static String VALUE_CLASS
| Constructor Detail |
|---|
public SequenceFileAsBinaryOutputFormat()
| Method Detail |
|---|
public static void setSequenceFileOutputKeyClass(Job job,
Class<?> theClass)
SequenceFile
This allows the user to specify the key class to be different
from the actual class (BytesWritable) used for writing
job - the Job to modifytheClass - the SequenceFile output key class.
public static void setSequenceFileOutputValueClass(Job job,
Class<?> theClass)
SequenceFile
This allows the user to specify the value class to be different
from the actual class (BytesWritable) used for writing
job - the Job to modifytheClass - the SequenceFile output key class.public static Class<? extends WritableComparable> getSequenceFileOutputKeyClass(JobContext job)
SequenceFile
SequenceFilepublic static Class<? extends Writable> getSequenceFileOutputValueClass(JobContext job)
SequenceFile
SequenceFile
public RecordWriter<BytesWritable,BytesWritable> getRecordWriter(TaskAttemptContext context)
throws IOException
OutputFormatRecordWriter for the given task.
getRecordWriter in class SequenceFileOutputFormat<BytesWritable,BytesWritable>context - the information about the current task.
RecordWriter to write the output for the job.
IOException
protected SequenceFile.Writer getSequenceWriter(TaskAttemptContext context,
Class<?> keyClass,
Class<?> valueClass)
throws IOException
IOException
public void checkOutputSpecs(JobContext job)
throws IOException
OutputFormatThis is to validate the output specification for the job when it is a job is submitted. Typically checks that it does not already exist, throwing an exception when it already exists, so that output is not overwritten.
checkOutputSpecs in class FileOutputFormat<BytesWritable,BytesWritable>job - information about the job
IOException - when output should not be attempted
|
||||||||||
| PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
| SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD | |||||||||