spark-rdd-CoGroupedRDD.adoc

CoGroupedRDD

A RDD that cogroups its pair RDD parents. For each key k in parent RDDs, the resulting RDD contains a tuple with the list of values for that key.

Use RDD.cogroup(…​) to create one.

getDependencies Method

Caution

FIXME

Computing Partition (in TaskContext) — compute Method

compute(s: Partition, context: TaskContext): Iterator[(K, Array[Iterable[_]])]

Note	compute is part of RDD Contract to compute a partition (in a TaskContext).

compute…​FIXME