org.datavec.spark.transform.sparkfunction.sequence

Class DataFrameToSequenceMergeValue

java.lang.Object

org.datavec.spark.transform.sparkfunction.sequence.DataFrameToSequenceMergeValue

All Implemented Interfaces:

java.io.Serializable, org.apache.spark.api.java.function.Function2<java.util.List<java.util.List<Writable>>,java.lang.Iterable<org.apache.spark.sql.Row>,java.util.List<java.util.List<Writable>>>

public class DataFrameToSequenceMergeValue
extends java.lang.Object
implements org.apache.spark.api.java.function.Function2<java.util.List<java.util.List<Writable>>,java.lang.Iterable<org.apache.spark.sql.Row>,java.util.List<java.util.List<Writable>>>

Combiner function for use in DataFrames#toRecordsSequence(DataFrame)

Assumption here: first two columns are the sequence UUID and the sequence index, as per DataFrames.toDataFrameSequence(Schema, JavaRDD)

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
DataFrameToSequenceMergeValue()

Method Summary

Modifier and Type	Method and Description
java.util.List<java.util.List<Writable>>	call(java.util.List<java.util.List<Writable>> seqSoFar, java.lang.Iterable<org.apache.spark.sql.Row> rows)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

DataFrameToSequenceMergeValue

public DataFrameToSequenceMergeValue()

Method Detail

call

public java.util.List<java.util.List<Writable>> call(java.util.List<java.util.List<Writable>> seqSoFar,
                                                     java.lang.Iterable<org.apache.spark.sql.Row> rows)
                                              throws java.lang.Exception

Specified by:

call in interface org.apache.spark.api.java.function.Function2<java.util.List<java.util.List<Writable>>,java.lang.Iterable<org.apache.spark.sql.Row>,java.util.List<java.util.List<Writable>>>

Throws:

java.lang.Exception