Modifier and Type | Method and Description |
---|---|
Configuration |
Configurable.getConf()
Return the configuration used by this object.
|
Configuration |
Configured.getConf() |
Modifier and Type | Method and Description |
---|---|
static void |
Configuration.dumpConfiguration(Configuration conf,
Writer out)
Writes out all the parameters and their properties (final and resource) to
the given
Writer
The format of the output would be
{ "properties" : [ {key1,value1,key1.isFinal,key1.resource}, {key2,value2,
key2.isFinal,key2.resource}... ] }
It does not output the parameters of the configuration object which is
loaded from an input stream. |
void |
Configurable.setConf(Configuration conf)
Set the configuration to be used by this object.
|
void |
Configured.setConf(Configuration conf) |
Constructor and Description |
---|
Configuration(Configuration other)
A new configuration with the same settings cloned from another.
|
Configured(Configuration conf)
Construct a Configured.
|
Modifier and Type | Method and Description |
---|---|
RecordReader |
InputFormat.createReader(InputSplit split,
Configuration conf)
Creates a reader from an input split
|
Modifier and Type | Method and Description |
---|---|
RecordReader |
CSVInputFormat.createReader(InputSplit split,
Configuration conf) |
RecordReader |
LibSvmInputFormat.createReader(InputSplit split,
Configuration conf) |
RecordReader |
LineInputFormat.createReader(InputSplit split,
Configuration conf) |
RecordReader |
ListStringInputFormat.createReader(InputSplit split,
Configuration conf)
Creates a reader from an input split
|
RecordReader |
MatlabInputFormat.createReader(InputSplit split,
Configuration conf) |
RecordReader |
SVMLightInputFormat.createReader(InputSplit split,
Configuration conf) |
Modifier and Type | Method and Description |
---|---|
RecordWriter |
OutputFormat.createWriter(Configuration conf)
Create a record writer
|
Modifier and Type | Method and Description |
---|---|
RecordWriter |
CSVOutputFormat.createWriter(Configuration conf) |
RecordWriter |
LibSvmOutputFormat.createWriter(Configuration conf) |
RecordWriter |
LineOutputFormat.createWriter(Configuration conf) |
RecordWriter |
SVMLightOutputFormat.createWriter(Configuration conf) |
Modifier and Type | Method and Description |
---|---|
static <T extends Writable> |
WritableUtils.clone(T orig,
Configuration conf)
Make a copy of a writable object using serialization to a buffer.
|
Constructor and Description |
---|
SerializationFactory(Configuration conf)
Serializations are found by reading the
io.serializations
property from conf , which is a comma-delimited list of
classnames. |
Modifier and Type | Method and Description |
---|---|
void |
RecordReader.initialize(Configuration conf,
InputSplit split)
Called once at initialization.
|
Modifier and Type | Field and Description |
---|---|
protected Configuration |
FileRecordReader.conf |
protected Configuration |
LineRecordReader.conf |
Modifier and Type | Method and Description |
---|---|
Configuration |
ComposableRecordReader.getConf() |
Configuration |
ConcatenatingRecordReader.getConf() |
Configuration |
FileRecordReader.getConf() |
Configuration |
LineRecordReader.getConf() |
Modifier and Type | Method and Description |
---|---|
void |
ComposableRecordReader.initialize(Configuration conf,
InputSplit split) |
void |
ConcatenatingRecordReader.initialize(Configuration conf,
InputSplit split) |
void |
FileRecordReader.initialize(Configuration conf,
InputSplit split) |
void |
LineRecordReader.initialize(Configuration conf,
InputSplit split) |
void |
ComposableRecordReader.setConf(Configuration conf) |
void |
ConcatenatingRecordReader.setConf(Configuration conf) |
void |
FileRecordReader.setConf(Configuration conf) |
void |
LineRecordReader.setConf(Configuration conf) |
Modifier and Type | Method and Description |
---|---|
Configuration |
CollectionRecordReader.getConf() |
Configuration |
CollectionSequenceRecordReader.getConf() |
Configuration |
ListStringRecordReader.getConf()
Return the configuration used by this object.
|
Modifier and Type | Method and Description |
---|---|
void |
CollectionRecordReader.initialize(Configuration conf,
InputSplit split) |
void |
CollectionSequenceRecordReader.initialize(Configuration conf,
InputSplit split) |
void |
ListStringRecordReader.initialize(Configuration conf,
InputSplit split)
Called once at initialization.
|
void |
CollectionRecordReader.setConf(Configuration conf) |
void |
CollectionSequenceRecordReader.setConf(Configuration conf) |
void |
ListStringRecordReader.setConf(Configuration conf)
Set the configuration to be used by this object.
|
Modifier and Type | Method and Description |
---|---|
void |
CSVNLinesSequenceRecordReader.initialize(Configuration conf,
InputSplit split) |
void |
CSVRecordReader.initialize(Configuration conf,
InputSplit split) |
void |
CSVVariableSlidingWindowRecordReader.initialize(Configuration conf,
InputSplit split) |
Modifier and Type | Method and Description |
---|---|
Configuration |
FileBatchRecordReader.getConf() |
Configuration |
FileBatchSequenceRecordReader.getConf() |
Modifier and Type | Method and Description |
---|---|
void |
FileBatchRecordReader.initialize(Configuration conf,
InputSplit split) |
void |
FileBatchSequenceRecordReader.initialize(Configuration conf,
InputSplit split) |
void |
FileBatchRecordReader.setConf(Configuration conf) |
void |
FileBatchSequenceRecordReader.setConf(Configuration conf) |
Modifier and Type | Method and Description |
---|---|
Configuration |
InMemoryRecordReader.getConf()
Return the configuration used by this object.
|
Configuration |
InMemorySequenceRecordReader.getConf()
Return the configuration used by this object.
|
Modifier and Type | Method and Description |
---|---|
void |
InMemoryRecordReader.initialize(Configuration conf,
InputSplit split)
Called once at initialization.
|
void |
InMemorySequenceRecordReader.initialize(Configuration conf,
InputSplit split)
Called once at initialization.
|
void |
InMemoryRecordReader.setConf(Configuration conf)
Set the configuration to be used by this object.
|
void |
InMemorySequenceRecordReader.setConf(Configuration conf)
Set the configuration to be used by this object.
|
Modifier and Type | Method and Description |
---|---|
Configuration |
JacksonRecordReader.getConf() |
Modifier and Type | Method and Description |
---|---|
void |
JacksonRecordReader.initialize(Configuration conf,
InputSplit split) |
void |
JacksonRecordReader.setConf(Configuration conf) |
Modifier and Type | Method and Description |
---|---|
void |
SVMLightRecordReader.initialize(Configuration conf,
InputSplit split)
Must be called before attempting to read records.
|
void |
LibSvmRecordReader.setConf(Configuration conf) |
void |
SVMLightRecordReader.setConf(Configuration conf)
Set configuration.
|
Modifier and Type | Method and Description |
---|---|
void |
RegexLineRecordReader.initialize(Configuration conf,
InputSplit split) |
void |
RegexSequenceRecordReader.initialize(Configuration conf,
InputSplit split) |
Modifier and Type | Method and Description |
---|---|
Configuration |
TransformProcessRecordReader.getConf()
Return the configuration used by this object.
|
Configuration |
TransformProcessSequenceRecordReader.getConf()
Return the configuration used by this object.
|
Modifier and Type | Method and Description |
---|---|
void |
TransformProcessRecordReader.initialize(Configuration conf,
InputSplit split)
Called once at initialization.
|
void |
TransformProcessSequenceRecordReader.initialize(Configuration conf,
InputSplit split)
Called once at initialization.
|
void |
TransformProcessRecordReader.setConf(Configuration conf)
Set the configuration to be used by this object.
|
void |
TransformProcessSequenceRecordReader.setConf(Configuration conf)
Set the configuration to be used by this object.
|
Modifier and Type | Method and Description |
---|---|
void |
RecordWriter.initialize(Configuration configuration,
InputSplit split,
Partitioner partitioner)
Initialize the record reader with the given configuration
and
InputSplit |
Modifier and Type | Field and Description |
---|---|
protected Configuration |
FileRecordWriter.conf |
Modifier and Type | Method and Description |
---|---|
Configuration |
FileRecordWriter.getConf() |
Modifier and Type | Method and Description |
---|---|
void |
FileRecordWriter.initialize(Configuration configuration,
InputSplit split,
Partitioner partitioner) |
void |
FileRecordWriter.setConf(Configuration conf) |
Modifier and Type | Method and Description |
---|---|
void |
SVMLightRecordWriter.setConf(Configuration conf)
Set DataVec configuration
|
Modifier and Type | Method and Description |
---|---|
void |
NumberOfRecordsPartitioner.init(Configuration configuration,
InputSplit split) |
void |
Partitioner.init(Configuration configuration,
InputSplit split)
Initializes this partitioner with the given configuration
and input split
|
Modifier and Type | Method and Description |
---|---|
static <T> T |
ReflectionUtils.copy(Configuration conf,
T src,
T dst)
Deprecated.
Make a copy of the writable object using serialization to a buffer
|
static <T> T |
ReflectionUtils.newInstance(Class<T> theClass,
Configuration conf)
Deprecated.
Create an object for the given class and initialize it from conf
|
static void |
ReflectionUtils.setConf(Object theObject,
Configuration conf)
Deprecated.
Check and set 'configuration' if necessary.
|
Modifier and Type | Method and Description |
---|---|
void |
Vectorizer.initialize(Configuration conf)
Initialize based on a configuration
|
Modifier and Type | Method and Description |
---|---|
Configuration |
ArrowRecordReader.getConf() |
Configuration |
ArrowRecordWriter.getConf() |
Modifier and Type | Method and Description |
---|---|
void |
ArrowRecordReader.initialize(Configuration conf,
InputSplit split) |
void |
ArrowRecordWriter.initialize(Configuration configuration,
InputSplit split,
Partitioner partitioner) |
void |
ArrowRecordReader.setConf(Configuration conf) |
void |
ArrowRecordWriter.setConf(Configuration conf) |
Modifier and Type | Method and Description |
---|---|
RecordReader |
WavInputFormat.createReader(InputSplit split,
Configuration conf) |
Modifier and Type | Method and Description |
---|---|
RecordWriter |
WaveOutputFormat.createWriter(Configuration conf) |
Modifier and Type | Method and Description |
---|---|
Configuration |
BaseAudioRecordReader.getConf() |
Modifier and Type | Method and Description |
---|---|
void |
BaseAudioRecordReader.initialize(Configuration conf,
InputSplit split) |
void |
BaseAudioRecordReader.setConf(Configuration conf) |
Modifier and Type | Method and Description |
---|---|
RecordReader |
CodecInputFormat.createReader(InputSplit split,
Configuration conf) |
Modifier and Type | Method and Description |
---|---|
Configuration |
BaseCodecRecordReader.getConf() |
Modifier and Type | Method and Description |
---|---|
void |
BaseCodecRecordReader.initialize(Configuration conf,
InputSplit split) |
void |
BaseCodecRecordReader.setConf(Configuration conf) |
void |
CodecRecordReader.setConf(Configuration conf) |
void |
NativeCodecRecordReader.setConf(Configuration conf) |
Modifier and Type | Method and Description |
---|---|
Configuration |
MapFileRecordReader.getConf() |
Configuration |
MapFileSequenceRecordReader.getConf() |
Modifier and Type | Method and Description |
---|---|
void |
MapFileRecordReader.initialize(Configuration conf,
InputSplit split) |
void |
MapFileSequenceRecordReader.initialize(Configuration conf,
InputSplit split) |
void |
MapFileRecordReader.setConf(Configuration conf) |
void |
MapFileSequenceRecordReader.setConf(Configuration conf) |
Modifier and Type | Method and Description |
---|---|
Configuration |
AbstractMapFileWriter.getConf() |
Modifier and Type | Method and Description |
---|---|
void |
MapFileRecordWriter.initialize(Configuration configuration,
InputSplit split,
Partitioner partitioner) |
void |
AbstractMapFileWriter.setConf(Configuration conf) |
Modifier and Type | Method and Description |
---|---|
RecordReader |
ImageInputFormat.createReader(InputSplit split,
Configuration conf) |
Modifier and Type | Field and Description |
---|---|
protected Configuration |
BaseImageRecordReader.conf |
Modifier and Type | Method and Description |
---|---|
Configuration |
BaseImageRecordReader.getConf() |
Modifier and Type | Method and Description |
---|---|
void |
BaseImageRecordReader.initialize(Configuration conf,
InputSplit split) |
void |
BaseImageRecordReader.initialize(Configuration conf,
InputSplit split,
ImageTransform imageTransform)
Called once at initialization.
|
void |
BaseImageRecordReader.setConf(Configuration conf) |
Modifier and Type | Method and Description |
---|---|
Configuration |
JDBCRecordReader.getConf() |
Modifier and Type | Method and Description |
---|---|
void |
JDBCRecordReader.initialize(Configuration conf,
InputSplit split)
Initialize all required jdbc elements and make the reader ready for iteration.
|
void |
JDBCRecordReader.setConf(Configuration conf) |
Modifier and Type | Method and Description |
---|---|
RecordReader |
TextInputFormat.createReader(InputSplit split,
Configuration conf) |
Modifier and Type | Method and Description |
---|---|
void |
DefaultVocabCache.initialize(Configuration conf) |
void |
VocabCache.initialize(Configuration conf)
Configuration for initializing
|
Modifier and Type | Method and Description |
---|---|
Configuration |
TfidfRecordReader.getConf() |
Modifier and Type | Method and Description |
---|---|
void |
TfidfRecordReader.initialize(Configuration conf,
InputSplit split) |
void |
TfidfRecordReader.setConf(Configuration conf) |
Modifier and Type | Method and Description |
---|---|
TokenizerFactory |
AbstractTfidfVectorizer.createTokenizerFactory(Configuration conf) |
abstract TokenizerFactory |
TextVectorizer.createTokenizerFactory(Configuration conf)
Create tokenizer factory based on the configuration
|
void |
TextVectorizer.initialize(Configuration conf) |
void |
TfidfVectorizer.initialize(Configuration conf) |
Modifier and Type | Method and Description |
---|---|
void |
ExcelRecordReader.initialize(Configuration conf,
InputSplit split) |
void |
ExcelRecordWriter.initialize(Configuration configuration,
InputSplit split,
Partitioner partitioner) |
Modifier and Type | Method and Description |
---|---|
Configuration |
SparkSourceDummyReader.getConf() |
Modifier and Type | Method and Description |
---|---|
void |
SparkSourceDummyReader.initialize(Configuration configuration,
InputSplit inputSplit) |
void |
SparkSourceDummyReader.setConf(Configuration configuration) |
Copyright © 2020. All rights reserved.