org.datavec.spark.transform.misc

Class ColumnAsKeyPairFunction

java.lang.Object

org.datavec.spark.transform.misc.ColumnAsKeyPairFunction

All Implemented Interfaces:

java.io.Serializable, org.apache.spark.api.java.function.PairFunction<java.util.List<Writable>,Writable,java.util.List<Writable>>

public class ColumnAsKeyPairFunction
extends java.lang.Object
implements org.apache.spark.api.java.function.PairFunction<java.util.List<Writable>,Writable,java.util.List<Writable>>

Very simple function to extract out one writable (by index) and use it as a key in the resulting PairRDD For example, myWritable.mapToPair(new ColumnsAsKeyPairFunction(myKeyColumnIdx))

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
ColumnAsKeyPairFunction()

Method Summary

Modifier and Type	Method and Description
scala.Tuple2<Writable,java.util.List<Writable>>	call(java.util.List<Writable> writables)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ColumnAsKeyPairFunction

public ColumnAsKeyPairFunction()

Method Detail

call

public scala.Tuple2<Writable,java.util.List<Writable>> call(java.util.List<Writable> writables)
                                                     throws java.lang.Exception

Specified by:

call in interface org.apache.spark.api.java.function.PairFunction<java.util.List<Writable>,Writable,java.util.List<Writable>>

Throws:

java.lang.Exception