org.deeplearning4j.spark.impl.paramavg.util

Class ExportSupport

java.lang.Object

org.deeplearning4j.spark.impl.paramavg.util.ExportSupport

public class ExportSupport
extends java.lang.Object

Utility for checking if exporting data sets is supported

Constructor Summary

Constructors

Constructor and Description
ExportSupport()

Method Summary

Modifier and Type	Method and Description
static void	assertExportSupported(org.apache.spark.api.java.JavaSparkContext sc) Verify that exporting data is supported, and throw an informative exception if not.
static boolean	exportSupported(org.apache.spark.api.java.JavaSparkContext sc) Check if exporting data is supported in the current environment.
static boolean	exportSupported(java.lang.String sparkMaster, org.apache.hadoop.fs.FileSystem fs) Check if exporting data is supported in the current environment.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ExportSupport

public ExportSupport()

Method Detail

assertExportSupported

public static void assertExportSupported(@NonNull
                                         org.apache.spark.api.java.JavaSparkContext sc)

Verify that exporting data is supported, and throw an informative exception if not.

Parameters:

sc - the Spark context

exportSupported

public static boolean exportSupported(@NonNull
                                      org.apache.spark.api.java.JavaSparkContext sc)

Check if exporting data is supported in the current environment. Exporting is possible in two cases: - The master is set to local. In this case any file system, including local FS, will work for exporting. - The file system is not local. Local file systems do not work in cluster modes.

Parameters:

sc - the Spark context

Returns:

if export is supported

exportSupported

public static boolean exportSupported(@NonNull
                                      java.lang.String sparkMaster,
                                      @NonNull
                                      org.apache.hadoop.fs.FileSystem fs)

Check if exporting data is supported in the current environment. Exporting is possible in two cases: - The master is set to local. In this case any file system, including local FS, will work for exporting. - The file system is not local. Local file systems do not work in cluster modes.

Parameters:

sparkMaster - the Spark master

fs - the Hadoop file system

Returns:

if export is supported