Uses of Class org.datavec.spark.util.SerializableHadoopConfig (deeplearning4j 1.0.0-beta6 API)

Skip navigation links

Prev
Next

All Classes

Packages that use SerializableHadoopConfig
Package	Description
org.datavec.spark.util
org.deeplearning4j.spark.api.worker
org.deeplearning4j.spark.data
org.deeplearning4j.spark.data.loader
org.deeplearning4j.spark.datavec.export
org.deeplearning4j.spark.impl.graph.evaluation
org.deeplearning4j.spark.impl.paramavg
org.deeplearning4j.spark.iterator
org.deeplearning4j.spark.parameterserver.functions
org.deeplearning4j.spark.util.data.validation

Uses of SerializableHadoopConfig in org.datavec.spark.util

Methods in org.datavec.spark.util that return types with arguments of type SerializableHadoopConfig
Modifier and Type	Method and Description
`static org.apache.spark.broadcast.Broadcast<SerializableHadoopConfig>`	BroadcastHadoopConfigHolder.`get(org.apache.spark.api.java.JavaSparkContext sc)`

Uses of SerializableHadoopConfig in org.deeplearning4j.spark.api.worker

Constructor parameters in org.deeplearning4j.spark.api.worker with type arguments of type SerializableHadoopConfig
Constructor and Description
`ExecuteWorkerPathFlatMap(TrainingWorker<R> worker, DataSetLoader dataSetLoader, org.apache.spark.broadcast.Broadcast<SerializableHadoopConfig> hadoopConfig)`
`ExecuteWorkerPathMDSFlatMap(TrainingWorker<R> worker, MultiDataSetLoader loader, org.apache.spark.broadcast.Broadcast<SerializableHadoopConfig> hadoopConfig)`

Uses of SerializableHadoopConfig in org.deeplearning4j.spark.data

Constructor parameters in org.deeplearning4j.spark.data with type arguments of type SerializableHadoopConfig
Constructor and Description
`BatchAndExportDataSetsFunction(int minibatchSize, String exportBaseDirectory, org.apache.spark.broadcast.Broadcast<SerializableHadoopConfig> configuration)`
`BatchAndExportMultiDataSetsFunction(int minibatchSize, String exportBaseDirectory, org.apache.spark.broadcast.Broadcast<SerializableHadoopConfig> configuration)`
`DataSetExportFunction(URI outputDir, org.apache.spark.broadcast.Broadcast<SerializableHadoopConfig> configuration)`
`MultiDataSetExportFunction(URI outputDir, org.apache.spark.broadcast.Broadcast<SerializableHadoopConfig> configuration)`
`PathToDataSetFunction(org.apache.spark.broadcast.Broadcast<SerializableHadoopConfig> configuration)`
`PathToMultiDataSetFunction(org.apache.spark.broadcast.Broadcast<SerializableHadoopConfig> configuration)`

Uses of SerializableHadoopConfig in org.deeplearning4j.spark.data.loader

Constructor parameters in org.deeplearning4j.spark.data.loader with type arguments of type SerializableHadoopConfig
Constructor and Description
`RemoteFileSourceFactory(org.apache.spark.broadcast.Broadcast<SerializableHadoopConfig> configuration)`

Uses of SerializableHadoopConfig in org.deeplearning4j.spark.datavec.export

Constructor parameters in org.deeplearning4j.spark.datavec.export with type arguments of type SerializableHadoopConfig
Constructor and Description
`StringToDataSetExportFunction(URI outputDir, RecordReader recordReader, int batchSize, boolean regression, int labelIndex, int numPossibleLabels, org.apache.spark.broadcast.Broadcast<SerializableHadoopConfig> configuration)`

Uses of SerializableHadoopConfig in org.deeplearning4j.spark.impl.graph.evaluation

Fields in org.deeplearning4j.spark.impl.graph.evaluation with type parameters of type SerializableHadoopConfig
Modifier and Type	Field and Description
`protected org.apache.spark.broadcast.Broadcast<SerializableHadoopConfig>`	IEvaluateMDSPathsFlatMapFunction.`conf`

Constructor parameters in org.deeplearning4j.spark.impl.graph.evaluation with type arguments of type SerializableHadoopConfig
Constructor and Description
`IEvaluateMDSPathsFlatMapFunction(org.apache.spark.broadcast.Broadcast<String> json, org.apache.spark.broadcast.Broadcast<byte[]> params, int evalNumWorkers, int evalBatchSize, DataSetLoader dsLoader, MultiDataSetLoader mdsLoader, org.apache.spark.broadcast.Broadcast<SerializableHadoopConfig> configuration, IEvaluation[] evaluations)`

Uses of SerializableHadoopConfig in org.deeplearning4j.spark.impl.paramavg

Fields in org.deeplearning4j.spark.impl.paramavg with type parameters of type SerializableHadoopConfig
Modifier and Type	Field and Description
`protected org.apache.spark.broadcast.Broadcast<SerializableHadoopConfig>`	BaseTrainingMaster.`broadcastHadoopConfig`

Uses of SerializableHadoopConfig in org.deeplearning4j.spark.iterator

Constructor parameters in org.deeplearning4j.spark.iterator with type arguments of type SerializableHadoopConfig
Constructor and Description
`PathSparkDataSetIterator(Collection<String> dataSetStreams, DataSetLoader dataSetLoader, org.apache.spark.broadcast.Broadcast<SerializableHadoopConfig> hadoopConfig)`
`PathSparkDataSetIterator(Iterator<String> iter, DataSetLoader dataSetLoader, org.apache.spark.broadcast.Broadcast<SerializableHadoopConfig> hadoopConfig)`
`PathSparkMultiDataSetIterator(Collection<String> dataSetStreams, MultiDataSetLoader loader, org.apache.spark.broadcast.Broadcast<SerializableHadoopConfig> hadoopConfig)`
`PathSparkMultiDataSetIterator(Iterator<String> iter, MultiDataSetLoader loader, org.apache.spark.broadcast.Broadcast<SerializableHadoopConfig> hadoopConfig)`

Uses of SerializableHadoopConfig in org.deeplearning4j.spark.parameterserver.functions

Fields in org.deeplearning4j.spark.parameterserver.functions with type parameters of type SerializableHadoopConfig
Modifier and Type	Field and Description
`protected org.apache.spark.broadcast.Broadcast<SerializableHadoopConfig>`	SharedFlatMapPathsMDS.`hadoopConfig`
`protected org.apache.spark.broadcast.Broadcast<SerializableHadoopConfig>`	SharedFlatMapPaths.`hadoopConfig`

Constructor parameters in org.deeplearning4j.spark.parameterserver.functions with type arguments of type SerializableHadoopConfig
Constructor and Description
`SharedFlatMapPaths(TrainingWorker<R> worker, DataSetLoader loader, org.apache.spark.broadcast.Broadcast<SerializableHadoopConfig> hadoopConfig)`
`SharedFlatMapPathsMDS(TrainingWorker<R> worker, MultiDataSetLoader loader, org.apache.spark.broadcast.Broadcast<SerializableHadoopConfig> hadoopConfig)`

Uses of SerializableHadoopConfig in org.deeplearning4j.spark.util.data.validation

Constructor parameters in org.deeplearning4j.spark.util.data.validation with type arguments of type SerializableHadoopConfig
Constructor and Description
`ValidateDataSetFn(boolean deleteInvalid, int[] featuresShape, int[] labelsShape, org.apache.spark.broadcast.Broadcast<SerializableHadoopConfig> configuration)`
`ValidateMultiDataSetFn(boolean deleteInvalid, int numFeatures, int numLabels, List<int[]> featuresShape, List<int[]> labelsShape, org.apache.spark.broadcast.Broadcast<SerializableHadoopConfig> configuration)`

Skip navigation links

Prev
Next

All Classes

Copyright © 2020. All rights reserved.