org.datavec.spark.transform.misc

Class ColumnToKeyPairTransform

java.lang.Object

org.datavec.spark.transform.misc.ColumnToKeyPairTransform

All Implemented Interfaces:

java.io.Serializable, org.apache.spark.api.java.function.PairFunction<java.util.List<Writable>,Writable,java.lang.Long>

public class ColumnToKeyPairTransform
extends java.lang.Object
implements org.apache.spark.api.java.function.PairFunction<java.util.List<Writable>,Writable,java.lang.Long>

Extract out one writable, and map it to a pair with count 1. Used to count the N most frequent values in a column, as in AnalyzeSpark.sampleMostFrequentFromColumn(int, String, Schema, JavaRDD)

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
ColumnToKeyPairTransform()

Method Summary

Modifier and Type	Method and Description
scala.Tuple2<Writable,java.lang.Long>	call(java.util.List<Writable> list)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ColumnToKeyPairTransform

public ColumnToKeyPairTransform()

Method Detail

call

public scala.Tuple2<Writable,java.lang.Long> call(java.util.List<Writable> list)
                                           throws java.lang.Exception

Specified by:

call in interface org.apache.spark.api.java.function.PairFunction<java.util.List<Writable>,Writable,java.lang.Long>

Throws:

java.lang.Exception