|
||||||||||
PREV NEXT | FRAMES NO FRAMES |
Packages that use RawKeyValueIterator | |
---|---|
org.apache.hadoop.mapred | A software framework for easily writing applications which process vast amounts of data (multi-terabyte data-sets) parallelly on large clusters (thousands of nodes) built of commodity hardware in a reliable, fault-tolerant manner. |
org.apache.hadoop.mapreduce.task |
Uses of RawKeyValueIterator in org.apache.hadoop.mapred |
---|
Classes in org.apache.hadoop.mapred that implement RawKeyValueIterator | |
---|---|
protected class |
MapTask.MapOutputBuffer.MRResultIterator
|
Methods in org.apache.hadoop.mapred that return RawKeyValueIterator | |
---|---|
RawKeyValueIterator |
ReduceTask.ReduceCopier.createKVIterator()
Create a RawKeyValueIterator from copied map outputs. |
RawKeyValueIterator |
ShuffleConsumerPlugin.createKVIterator()
To create a key-value iterator to read the merged output. |
Methods in org.apache.hadoop.mapred with parameters of type RawKeyValueIterator | ||
---|---|---|
abstract void |
Task.CombinerRunner.combine(RawKeyValueIterator iterator,
OutputCollector<K,V> collector)
Run the combiner over a set of inputs. |
|
void |
Task.OldCombinerRunner.combine(RawKeyValueIterator kvIter,
OutputCollector<K,V> combineCollector)
|
|
void |
Task.NewCombinerRunner.combine(RawKeyValueIterator iterator,
OutputCollector<K,V> collector)
|
|
protected static
|
Task.createReduceContext(Reducer<INKEY,INVALUE,OUTKEY,OUTVALUE> reducer,
org.apache.hadoop.conf.Configuration job,
TaskAttemptID taskId,
RawKeyValueIterator rIter,
Counter inputKeyCounter,
Counter inputValueCounter,
RecordWriter<OUTKEY,OUTVALUE> output,
OutputCommitter committer,
StatusReporter reporter,
org.apache.hadoop.io.RawComparator<INKEY> comparator,
java.lang.Class<INKEY> keyClass,
java.lang.Class<INVALUE> valueClass)
|
Constructors in org.apache.hadoop.mapred with parameters of type RawKeyValueIterator | |
---|---|
Task.CombineValuesIterator(RawKeyValueIterator in,
org.apache.hadoop.io.RawComparator<KEY> comparator,
java.lang.Class<KEY> keyClass,
java.lang.Class<VALUE> valClass,
org.apache.hadoop.conf.Configuration conf,
Reporter reporter,
Counters.Counter combineInputCounter)
|
Uses of RawKeyValueIterator in org.apache.hadoop.mapreduce.task |
---|
Constructors in org.apache.hadoop.mapreduce.task with parameters of type RawKeyValueIterator | |
---|---|
ReduceContextImpl(org.apache.hadoop.conf.Configuration conf,
TaskAttemptID taskid,
RawKeyValueIterator input,
Counter inputKeyCounter,
Counter inputValueCounter,
RecordWriter<KEYOUT,VALUEOUT> output,
OutputCommitter committer,
StatusReporter reporter,
org.apache.hadoop.io.RawComparator<KEYIN> comparator,
java.lang.Class<KEYIN> keyClass,
java.lang.Class<VALUEIN> valueClass)
|
|
||||||||||
PREV NEXT | FRAMES NO FRAMES |