org.datavec.dataframe.api

Class CategoryColumn

java.lang.Object

org.datavec.dataframe.columns.AbstractColumn

org.datavec.dataframe.api.CategoryColumn

All Implemented Interfaces:

java.lang.Iterable<java.lang.String>, CategoryColumnUtils, Column, CategoryFilters, StringMapUtils, CategoryReduceUtils

public class CategoryColumn
extends AbstractColumn
implements CategoryFilters, CategoryColumnUtils, java.lang.Iterable<java.lang.String>

A column in a base table that contains float values

Field Summary

Fields

Modifier and Type	Field and Description
static java.lang.String	MISSING_VALUE
it.unimi.dsi.fastutil.ints.IntComparator	rowComparator

Fields inherited from interface org.datavec.dataframe.columns.CategoryColumnUtils

isMissing, isNotMissing

Constructor Summary

Constructors

Constructor and Description
CategoryColumn(ColumnMetadata metadata)
CategoryColumn(java.lang.String name, int size)

Method Summary

Modifier and Type	Method and Description
void	add(java.lang.String stringValue)
void	addAll(java.util.List<java.lang.String> stringValues) Add all the strings in the list to this column
void	addCell(java.lang.String object)
void	append(Column column)
CategoryColumn	appendString(CategoryColumn append) Return a copy of this column with the given string appended
CategoryColumn	appendString(java.lang.String append) Return a copy of this column with the given string appended
byte[]	asBytes(int rowNumber) Returns the contents of the cell at rowNumber as a byte[]
java.util.Set<java.lang.String>	asSet()
java.util.List<java.lang.String>	bottom(int n) Returns the smallest ("bottom") n values in the column
int	byteSize() Returns the width of a cell in this column, in bytes
void	clear()
boolean	contains(java.lang.String aString) Returns true if this column contains a cell with the given string, and false otherwise
static java.lang.String	convert(java.lang.String stringValue)
CategoryColumn	copy() Returns a deep copy of the receiver
Table	countByCategory()
int	countMissing() Returns the count of missing values in this column
int	countUnique() Returns the count of unique values in this column
static CategoryColumn	create(java.lang.String name)
static CategoryColumn	create(java.lang.String name, int size)
static CategoryColumn	create(java.lang.String name, java.util.List<java.lang.String> categories)
it.unimi.dsi.fastutil.ints.IntArrayList	data() Returns the integers that back this column
DictionaryMap	dictionaryMap()
CategoryColumn	emptyCopy() Returns a copy of the receiver with no data.
CategoryColumn	emptyCopy(int rowSize) Returns an empty copy of the receiver, with its internal storage initialized to the given row size
java.lang.String	get(int rowIndex) Returns the value at rowIndex in this column.
java.util.List<BooleanColumn>	getDummies() Returns a list of boolean columns suitable for use as dummy variables in, for example, regression analysis, selectWhere a column of categorical data must be encoded as a list of columns, such that each column represents a single category and indicates whether it is present (1) or not present (0)
int	getInt(int rowNumber)
java.lang.String	getString(int row) Returns a string representation of the value at the given row
it.unimi.dsi.fastutil.ints.IntArrayList	getValues(it.unimi.dsi.fastutil.ints.IntArrayList indexes) Returns all the values associated with the given indexes
int[]	indexes() Return the raw indexes that this column contains.
void	initializeWith(it.unimi.dsi.fastutil.ints.IntArrayList list, DictionaryMap map) Initializes this Column with the given values for performance
boolean	isEmpty() Returns true if the column has no data
Selection	isEqualTo(java.lang.String string)
Selection	isIn(java.lang.String... strings)
Selection	isInSet(java.util.Collection<java.lang.String> values2)
Selection	isMissing()
Selection	isNotEqualTo(java.lang.String string)
Selection	isNotInSet(java.util.Collection<java.lang.String> values2)
Selection	isNotMissing()
java.util.Iterator<java.lang.String>	iterator()
java.lang.String	print()
CategoryColumn	replaceAll(java.lang.String[] regexArray, java.lang.String replacement) Return a copy of this column with the given regular expressions array applied to a find and replace
it.unimi.dsi.fastutil.ints.IntComparator	rowComparator()
Selection	select(StringBiPredicate predicate, java.lang.String value)
Selection	select(StringPredicate predicate)
CategoryColumn	selectIf(StringPredicate predicate)
void	set(int rowIndex, java.lang.String stringValue)
int	size() Returns the number of elements (a.k.a.
void	sortAscending()
void	sortDescending()
Table	summary()
IntColumn	toIntColumn()
CategoryColumn	tokenizeAndRemoveDuplicates()
CategoryColumn	tokenizeAndSort() Splits on Whitespace and returns the lexicographically sorted result
CategoryColumn	tokenizeAndSort(java.lang.String separator)
java.util.List<java.lang.String>	toList()
java.util.List<java.lang.String>	top(int n) Returns the largest ("top") n values in the column
java.lang.String	toString()
ColumnType	type() Returns this column's ColumnType
CategoryColumn	unique() Returns a column of the same type as the receiver, containing only the unique values of the receiver
it.unimi.dsi.fastutil.ints.IntArrayList	values() Returns the integer encoded value of each cell in this column.

Methods inherited from class org.datavec.dataframe.columns.AbstractColumn

columnMetadata, columnWidth, comment, difference, id, metadata, name, setComment, setName

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface org.datavec.dataframe.filtering.text.CategoryFilters

empty, endsWith, equalToIgnoringCase, hasLengthEqualTo, isAlpha, isAlphaNumeric, isLongerThan, isLowerCase, isNumeric, isShorterThan, isUpperCase, matchesRegex, startsWith, stringContains

Methods inherited from interface org.datavec.dataframe.mapping.StringMapUtils

abbreviate, commonPrefix, commonSuffix, distance, join, lowerCase, padEnd, padStart, replaceAll, replaceFirst, substring, substring, trim, upperCase

Methods inherited from interface org.datavec.dataframe.reducing.CategoryReduceUtils

appendAll, appendAll

Methods inherited from interface org.datavec.dataframe.columns.Column

columnMetadata, columnWidth, comment, difference, first, first, id, last, last, metadata, name, setComment, setName, subset, title, toDoubleArray

Methods inherited from interface java.lang.Iterable

forEach, spliterator

Field Detail

MISSING_VALUE

public static final java.lang.String MISSING_VALUE

rowComparator

public final it.unimi.dsi.fastutil.ints.IntComparator rowComparator

Constructor Detail

CategoryColumn

public CategoryColumn(ColumnMetadata metadata)

CategoryColumn

public CategoryColumn(java.lang.String name,
                      int size)

Method Detail

create

public static CategoryColumn create(java.lang.String name)

create

public static CategoryColumn create(java.lang.String name,
                                    int size)

create

public static CategoryColumn create(java.lang.String name,
                                    java.util.List<java.lang.String> categories)

type

public ColumnType type()

Description copied from interface: Column

Returns this column's ColumnType

Specified by:

type in interface Column

getString

public java.lang.String getString(int row)

Description copied from interface: Column

Returns a string representation of the value at the given row

Specified by:

getString in interface Column

emptyCopy

public CategoryColumn emptyCopy()

Description copied from interface: Column

Returns a copy of the receiver with no data. The column name and type are the same

Specified by:

emptyCopy in interface Column

emptyCopy

public CategoryColumn emptyCopy(int rowSize)

Description copied from interface: Column

Returns an empty copy of the receiver, with its internal storage initialized to the given row size

Specified by:

emptyCopy in interface Column

sortAscending

public void sortAscending()

Specified by:

sortAscending in interface Column

sortDescending

public void sortDescending()

Specified by:

sortDescending in interface Column

size

public int size()

Returns the number of elements (a.k.a. rows or cells) in the column

Specified by:

size in interface Column

Specified by:

size in interface CategoryReduceUtils

get

public java.lang.String get(int rowIndex)

Returns the value at rowIndex in this column. The index is zero-based.

Throws:

java.lang.IndexOutOfBoundsException - if the given rowIndex is not in the column

toList

public java.util.List<java.lang.String> toList()

summary

public Table summary()

Specified by:

summary in interface Column

countByCategory

public Table countByCategory()

clear

public void clear()

Specified by:

clear in interface Column

set

public void set(int rowIndex,
                java.lang.String stringValue)

countUnique

public int countUnique()

Description copied from interface: Column

Returns the count of unique values in this column

Specified by:

countUnique in interface Column

top

public java.util.List<java.lang.String> top(int n)

Returns the largest ("top") n values in the column

Parameters:

n - The maximum number of records to return. The actual number will be smaller if n is greater than the number of observations in the column

Returns:

A list, possibly empty, of the largest observations

bottom

public java.util.List<java.lang.String> bottom(int n)

Returns the smallest ("bottom") n values in the column

Parameters:

n - The maximum number of records to return. The actual number will be smaller if n is greater than the number of observations in the column

Returns:

A list, possibly empty, of the smallest n observations

add

public void add(java.lang.String stringValue)

initializeWith

public void initializeWith(it.unimi.dsi.fastutil.ints.IntArrayList list,
                           DictionaryMap map)

Initializes this Column with the given values for performance

contains

public boolean contains(java.lang.String aString)

Returns true if this column contains a cell with the given string, and false otherwise

getValues

public it.unimi.dsi.fastutil.ints.IntArrayList getValues(it.unimi.dsi.fastutil.ints.IntArrayList indexes)

Returns all the values associated with the given indexes

addAll

public void addAll(java.util.List<java.lang.String> stringValues)

Add all the strings in the list to this column

convert

public static java.lang.String convert(java.lang.String stringValue)

addCell

public void addCell(java.lang.String object)

Specified by:

addCell in interface Column

Specified by:

addCell in class AbstractColumn

rowComparator

public it.unimi.dsi.fastutil.ints.IntComparator rowComparator()

Specified by:

rowComparator in interface Column

isEmpty

public boolean isEmpty()

Description copied from interface: Column

Returns true if the column has no data

Specified by:

isEmpty in interface Column

isInSet

public Selection isInSet(java.util.Collection<java.lang.String> values2)

isEqualTo

public Selection isEqualTo(java.lang.String string)

isNotInSet

public Selection isNotInSet(java.util.Collection<java.lang.String> values2)

isNotEqualTo

public Selection isNotEqualTo(java.lang.String string)

getDummies

public java.util.List<BooleanColumn> getDummies()

Returns a list of boolean columns suitable for use as dummy variables in, for example, regression analysis, selectWhere a column of categorical data must be encoded as a list of columns, such that each column represents a single category and indicates whether it is present (1) or not present (0)

getInt

public int getInt(int rowNumber)

unique

public CategoryColumn unique()

Description copied from interface: Column

Returns a column of the same type as the receiver, containing only the unique values of the receiver

Specified by:

unique in interface Column

data

public it.unimi.dsi.fastutil.ints.IntArrayList data()

Returns the integers that back this column

toIntColumn

public IntColumn toIntColumn()

dictionaryMap

public DictionaryMap dictionaryMap()

Specified by:

dictionaryMap in interface CategoryColumnUtils

toString

public java.lang.String toString()

Overrides:

toString in class java.lang.Object

indexes

public int[] indexes()

Return the raw indexes that this column contains.

Returns:

appendString

public CategoryColumn appendString(CategoryColumn append)

Return a copy of this column with the given string appended

Parameters:

append - the string to append

Returns:

the new columns

appendString

public CategoryColumn appendString(java.lang.String append)

Return a copy of this column with the given string appended

Parameters:

append - the string to append

Returns:

the new columns

replaceAll

public CategoryColumn replaceAll(java.lang.String[] regexArray,
                                 java.lang.String replacement)

Return a copy of this column with the given regular expressions array applied to a find and replace

Parameters:

regexArray - the regex array to replace

replacement - the replacement array

Returns:

the new column

tokenizeAndSort

public CategoryColumn tokenizeAndSort(java.lang.String separator)

tokenizeAndSort

public CategoryColumn tokenizeAndSort()

Splits on Whitespace and returns the lexicographically sorted result

tokenizeAndRemoveDuplicates

public CategoryColumn tokenizeAndRemoveDuplicates()

print

public java.lang.String print()

Specified by:

print in interface Column

isMissing

public Selection isMissing()

Specified by:

isMissing in interface Column

isNotMissing

public Selection isNotMissing()

Specified by:

isNotMissing in interface Column

select

public Selection select(StringPredicate predicate)

select

public Selection select(StringBiPredicate predicate,
                        java.lang.String value)

copy

public CategoryColumn copy()

Description copied from interface: Column

Returns a deep copy of the receiver

Specified by:

copy in interface Column

append

public void append(Column column)

Specified by:

append in interface Column

countMissing

public int countMissing()

Returns the count of missing values in this column

Specified by:

countMissing in interface Column

iterator

public java.util.Iterator<java.lang.String> iterator()

Specified by:

iterator in interface java.lang.Iterable<java.lang.String>

selectIf

public CategoryColumn selectIf(StringPredicate predicate)

asSet

public java.util.Set<java.lang.String> asSet()

values

public it.unimi.dsi.fastutil.ints.IntArrayList values()

Returns the integer encoded value of each cell in this column. It can be used to lookup the mapped string in the lookupTable

Specified by:

values in interface CategoryColumnUtils

byteSize

public int byteSize()

Description copied from interface: Column

Returns the width of a cell in this column, in bytes

Specified by:

byteSize in interface Column

asBytes

public byte[] asBytes(int rowNumber)

Returns the contents of the cell at rowNumber as a byte[]

Specified by:

asBytes in interface Column

isIn

public Selection isIn(java.lang.String... strings)