|
||||||||||
PREV NEXT | FRAMES NO FRAMES |
Packages that use CompressionCodec | |
---|---|
org.apache.hadoop.io | Generic i/o code for use when reading and writing data to the network, to databases, and to files. |
org.apache.hadoop.io.compress | |
org.apache.hadoop.mapred | A software framework for easily writing applications which process vast amounts of data (multi-terabyte data-sets) parallelly on large clusters (thousands of nodes) built of commodity hardware in a reliable, fault-tolerant manner. |
Uses of CompressionCodec in org.apache.hadoop.io |
---|
Methods in org.apache.hadoop.io that return CompressionCodec | |
---|---|
CompressionCodec |
SequenceFile.Writer.getCompressionCodec()
Returns the compression codec of data in this file. |
CompressionCodec |
SequenceFile.Reader.getCompressionCodec()
Returns the compression codec of data in this file. |
Methods in org.apache.hadoop.io with parameters of type CompressionCodec | |
---|---|
static SequenceFile.Writer |
SequenceFile.createWriter(Configuration conf,
FSDataOutputStream out,
Class keyClass,
Class valClass,
SequenceFile.CompressionType compressionType,
CompressionCodec codec)
Construct the preferred type of 'raw' SequenceFile Writer. |
static SequenceFile.Writer |
SequenceFile.createWriter(Configuration conf,
FSDataOutputStream out,
Class keyClass,
Class valClass,
SequenceFile.CompressionType compressionType,
CompressionCodec codec,
SequenceFile.Metadata metadata)
Construct the preferred type of 'raw' SequenceFile Writer. |
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
int bufferSize,
short replication,
long blockSize,
SequenceFile.CompressionType compressionType,
CompressionCodec codec,
Progressable progress,
SequenceFile.Metadata metadata)
Construct the preferred type of SequenceFile Writer. |
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
SequenceFile.CompressionType compressionType,
CompressionCodec codec)
Construct the preferred type of SequenceFile Writer. |
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
SequenceFile.CompressionType compressionType,
CompressionCodec codec,
Progressable progress)
Construct the preferred type of SequenceFile Writer. |
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
SequenceFile.CompressionType compressionType,
CompressionCodec codec,
Progressable progress,
SequenceFile.Metadata metadata)
Construct the preferred type of SequenceFile Writer. |
Constructors in org.apache.hadoop.io with parameters of type CompressionCodec | |
---|---|
MapFile.Writer(Configuration conf,
FileSystem fs,
String dirName,
Class keyClass,
Class valClass,
SequenceFile.CompressionType compress,
CompressionCodec codec,
Progressable progress)
Create the named map for keys of the named class. |
|
MapFile.Writer(Configuration conf,
FileSystem fs,
String dirName,
WritableComparator comparator,
Class valClass,
SequenceFile.CompressionType compress,
CompressionCodec codec,
Progressable progress)
Create the named map using the named key comparator. |
Uses of CompressionCodec in org.apache.hadoop.io.compress |
---|
Classes in org.apache.hadoop.io.compress that implement CompressionCodec | |
---|---|
class |
DefaultCodec
|
class |
GzipCodec
This class creates gzip compressors/decompressors. |
class |
LzoCodec
A CompressionCodec for a streaming
lzo compression/decompression pair. |
Methods in org.apache.hadoop.io.compress that return CompressionCodec | |
---|---|
CompressionCodec |
CompressionCodecFactory.getCodec(Path file)
Find the relevant compression codec for the given file based on its filename suffix. |
Methods in org.apache.hadoop.io.compress with parameters of type CompressionCodec | |
---|---|
static Compressor |
CodecPool.getCompressor(CompressionCodec codec)
Get a Compressor for the given CompressionCodec from the
pool or a new one. |
static Decompressor |
CodecPool.getDecompressor(CompressionCodec codec)
Get a Decompressor for the given CompressionCodec from the
pool or a new one. |
Uses of CompressionCodec in org.apache.hadoop.mapred |
---|
Methods in org.apache.hadoop.mapred that return types with arguments of type CompressionCodec | |
---|---|
Class<? extends CompressionCodec> |
JobConf.getMapOutputCompressorClass(Class<? extends CompressionCodec> defaultValue)
Get the CompressionCodec for compressing the map outputs. |
static Class<? extends CompressionCodec> |
OutputFormatBase.getOutputCompressorClass(JobConf conf,
Class<? extends CompressionCodec> defaultValue)
Deprecated. Get the CompressionCodec for compressing the job outputs. |
static Class<? extends CompressionCodec> |
FileOutputFormat.getOutputCompressorClass(JobConf conf,
Class<? extends CompressionCodec> defaultValue)
Get the CompressionCodec for compressing the job outputs. |
Method parameters in org.apache.hadoop.mapred with type arguments of type CompressionCodec | |
---|---|
Class<? extends CompressionCodec> |
JobConf.getMapOutputCompressorClass(Class<? extends CompressionCodec> defaultValue)
Get the CompressionCodec for compressing the map outputs. |
static Class<? extends CompressionCodec> |
OutputFormatBase.getOutputCompressorClass(JobConf conf,
Class<? extends CompressionCodec> defaultValue)
Deprecated. Get the CompressionCodec for compressing the job outputs. |
static Class<? extends CompressionCodec> |
FileOutputFormat.getOutputCompressorClass(JobConf conf,
Class<? extends CompressionCodec> defaultValue)
Get the CompressionCodec for compressing the job outputs. |
void |
JobConf.setMapOutputCompressorClass(Class<? extends CompressionCodec> codecClass)
Set the given class as the CompressionCodec for the map outputs. |
static void |
OutputFormatBase.setOutputCompressorClass(JobConf conf,
Class<? extends CompressionCodec> codecClass)
Deprecated. Set the CompressionCodec to be used to compress job outputs. |
static void |
FileOutputFormat.setOutputCompressorClass(JobConf conf,
Class<? extends CompressionCodec> codecClass)
Set the CompressionCodec to be used to compress job outputs. |
|
||||||||||
PREV NEXT | FRAMES NO FRAMES |