org.datavec.spark.transform.sparkfunction.sequence

Class DataFrameToSequenceMergeCombiner

java.lang.Object

org.datavec.spark.transform.sparkfunction.sequence.DataFrameToSequenceMergeCombiner

All Implemented Interfaces:

java.io.Serializable, org.apache.spark.api.java.function.Function2<java.util.List<java.util.List<Writable>>,java.util.List<java.util.List<Writable>>,java.util.List<java.util.List<Writable>>>

public class DataFrameToSequenceMergeCombiner
extends java.lang.Object
implements org.apache.spark.api.java.function.Function2<java.util.List<java.util.List<Writable>>,java.util.List<java.util.List<Writable>>,java.util.List<java.util.List<Writable>>>

Combiner function for use in DataFrames#toRecordsSequence(Dataset)

Assumption here: first two columns are the sequence UUID and the sequence index, as per DataFrames.toDataFrameSequence(Schema, JavaRDD)

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
DataFrameToSequenceMergeCombiner()

Method Summary

Modifier and Type	Method and Description
java.util.List<java.util.List<Writable>>	call(java.util.List<java.util.List<Writable>> v1, java.util.List<java.util.List<Writable>> v2)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

DataFrameToSequenceMergeCombiner

public DataFrameToSequenceMergeCombiner()

Method Detail

call

public java.util.List<java.util.List<Writable>> call(java.util.List<java.util.List<Writable>> v1,
                                                     java.util.List<java.util.List<Writable>> v2)
                                              throws java.lang.Exception

Specified by:

call in interface org.apache.spark.api.java.function.Function2<java.util.List<java.util.List<Writable>>,java.util.List<java.util.List<Writable>>,java.util.List<java.util.List<Writable>>>

Throws:

java.lang.Exception