|
||||||||||
PREV NEXT | FRAMES NO FRAMES |
Packages that use InputSplit | |
---|---|
org.apache.hadoop.contrib.index.example | |
org.apache.hadoop.examples | Hadoop example code. |
org.apache.hadoop.mapred | A software framework for easily writing applications which process vast amounts of data (multi-terabyte data-sets) parallelly on large clusters (thousands of nodes) built of commodity hardware in a reliable, fault-tolerant manner. |
org.apache.hadoop.mapred.join | Given a set of sorted datasets keyed with the same class and yielding equal partitions, it is possible to effect a join of those datasets prior to the map. |
org.apache.hadoop.mapred.lib | Library of generally useful mappers, reducers, and partitioners. |
org.apache.hadoop.streaming | Hadoop Streaming is a utility which allows users to create and run Map-Reduce jobs with any executables (e.g. |
Uses of InputSplit in org.apache.hadoop.contrib.index.example |
---|
Methods in org.apache.hadoop.contrib.index.example with parameters of type InputSplit | |
---|---|
RecordReader<DocumentID,LineDocTextAndOp> |
LineDocInputFormat.getRecordReader(InputSplit split,
JobConf job,
Reporter reporter)
|
Uses of InputSplit in org.apache.hadoop.examples |
---|
Methods in org.apache.hadoop.examples with parameters of type InputSplit | |
---|---|
RecordReader<MultiFileWordCount.WordOffset,Text> |
MultiFileWordCount.MyInputFormat.getRecordReader(InputSplit split,
JobConf job,
Reporter reporter)
|
Uses of InputSplit in org.apache.hadoop.mapred |
---|
Classes in org.apache.hadoop.mapred that implement InputSplit | |
---|---|
class |
FileSplit
A section of an input file. |
class |
MultiFileSplit
A sub-collection of input files. |
Methods in org.apache.hadoop.mapred that return InputSplit | |
---|---|
InputSplit |
Reporter.getInputSplit()
Get the InputSplit object for a map. |
InputSplit[] |
MultiFileInputFormat.getSplits(JobConf job,
int numSplits)
|
InputSplit[] |
FileInputFormat.getSplits(JobConf job,
int numSplits)
Splits files returned by FileInputFormat.listStatus(JobConf) when
they're too big. |
InputSplit[] |
InputFormat.getSplits(JobConf job,
int numSplits)
Logically split the set of input files for the job. |
Methods in org.apache.hadoop.mapred with parameters of type InputSplit | |
---|---|
RecordReader<LongWritable,Text> |
TextInputFormat.getRecordReader(InputSplit genericSplit,
JobConf job,
Reporter reporter)
|
RecordReader<K,V> |
SequenceFileInputFilter.getRecordReader(InputSplit split,
JobConf job,
Reporter reporter)
Create a record reader for the given split |
RecordReader<Text,Text> |
SequenceFileAsTextInputFormat.getRecordReader(InputSplit split,
JobConf job,
Reporter reporter)
|
RecordReader<K,V> |
SequenceFileInputFormat.getRecordReader(InputSplit split,
JobConf job,
Reporter reporter)
|
RecordReader<BytesWritable,BytesWritable> |
SequenceFileAsBinaryInputFormat.getRecordReader(InputSplit split,
JobConf job,
Reporter reporter)
|
abstract RecordReader<K,V> |
MultiFileInputFormat.getRecordReader(InputSplit split,
JobConf job,
Reporter reporter)
|
RecordReader<Text,Text> |
KeyValueTextInputFormat.getRecordReader(InputSplit genericSplit,
JobConf job,
Reporter reporter)
|
abstract RecordReader<K,V> |
FileInputFormat.getRecordReader(InputSplit split,
JobConf job,
Reporter reporter)
|
RecordReader<K,V> |
InputFormat.getRecordReader(InputSplit split,
JobConf job,
Reporter reporter)
Get the RecordReader for the given InputSplit . |
Uses of InputSplit in org.apache.hadoop.mapred.join |
---|
Classes in org.apache.hadoop.mapred.join that implement InputSplit | |
---|---|
class |
CompositeInputSplit
This InputSplit contains a set of child InputSplits. |
Methods in org.apache.hadoop.mapred.join that return InputSplit | |
---|---|
InputSplit |
CompositeInputSplit.get(int i)
Get ith child InputSplit. |
InputSplit[] |
CompositeInputFormat.getSplits(JobConf job,
int numSplits)
Build a CompositeInputSplit from the child InputFormats by assigning the ith split from each child to the ith composite split. |
Methods in org.apache.hadoop.mapred.join with parameters of type InputSplit | |
---|---|
void |
CompositeInputSplit.add(InputSplit s)
Add an InputSplit to this collection. |
ComposableRecordReader<K,TupleWritable> |
CompositeInputFormat.getRecordReader(InputSplit split,
JobConf job,
Reporter reporter)
Construct a CompositeRecordReader for the children of this InputFormat as defined in the init expression. |
ComposableRecordReader<K,V> |
ComposableInputFormat.getRecordReader(InputSplit split,
JobConf job,
Reporter reporter)
|
Uses of InputSplit in org.apache.hadoop.mapred.lib |
---|
Methods in org.apache.hadoop.mapred.lib that return InputSplit | |
---|---|
InputSplit[] |
NLineInputFormat.getSplits(JobConf job,
int numSplits)
Logically splits the set of input files for the job, splits N lines of the input as one split. |
Methods in org.apache.hadoop.mapred.lib with parameters of type InputSplit | |
---|---|
RecordReader<LongWritable,Text> |
NLineInputFormat.getRecordReader(InputSplit genericSplit,
JobConf job,
Reporter reporter)
|
Uses of InputSplit in org.apache.hadoop.streaming |
---|
Methods in org.apache.hadoop.streaming with parameters of type InputSplit | |
---|---|
RecordReader<Text,Text> |
StreamInputFormat.getRecordReader(InputSplit genericSplit,
JobConf job,
Reporter reporter)
|
|
||||||||||
PREV NEXT | FRAMES NO FRAMES |