public class SequenceRecordReaderDataSetIterator extends Object implements DataSetIterator
SequenceRecordReaderDataSetIterator.AlignmentMode
mode.Modifier and Type | Class and Description |
---|---|
static class |
SequenceRecordReaderDataSetIterator.AlignmentMode
Alignment mode for dealing with input/labels of differing lengths (for example, one-to-many and many-to-one type situations).
|
Constructor and Description |
---|
SequenceRecordReaderDataSetIterator(SequenceRecordReader reader,
int miniBatchSize,
int numPossibleLabels,
int labelIndex)
Constructor where features and labels come from the SAME RecordReader (i.e., target/label is a column in the
same data as the features).
|
SequenceRecordReaderDataSetIterator(SequenceRecordReader reader,
int miniBatchSize,
int numPossibleLabels,
int labelIndex,
boolean regression)
Constructor where features and labels come from the SAME RecordReader (i.e., target/label is a column in the
same data as the features)
|
SequenceRecordReaderDataSetIterator(SequenceRecordReader featuresReader,
SequenceRecordReader labels,
int miniBatchSize,
int numPossibleLabels)
Constructor where features and labels come from different RecordReaders (for example, different files),
and labels are for classification.
|
SequenceRecordReaderDataSetIterator(SequenceRecordReader featuresReader,
SequenceRecordReader labels,
int miniBatchSize,
int numPossibleLabels,
boolean regression)
Constructor where features and labels come from different RecordReaders (for example, different files)
|
SequenceRecordReaderDataSetIterator(SequenceRecordReader featuresReader,
SequenceRecordReader labels,
int miniBatchSize,
int numPossibleLabels,
boolean regression,
SequenceRecordReaderDataSetIterator.AlignmentMode alignmentMode)
Constructor where features and labels come from different RecordReaders (for example, different files)
|
Modifier and Type | Method and Description |
---|---|
boolean |
asyncSupported()
Does this DataSetIterator support asynchronous prefetching of multiple DataSet objects?
|
int |
batch()
Batch size
|
List<String> |
getLabels()
Get dataset iterator class labels, if any.
|
boolean |
hasNext() |
int |
inputColumns()
Input columns for the dataset
|
DataSet |
loadFromMetaData(List<RecordMetaData> list)
Load a multiple sequence examples to a DataSet, using the provided RecordMetaData instances.
|
DataSet |
loadFromMetaData(RecordMetaData recordMetaData)
Load a single sequence example to a DataSet, using the provided RecordMetaData.
|
DataSet |
next() |
DataSet |
next(int num)
Like the standard next method but allows a
customizable number of examples returned
|
void |
remove() |
void |
reset()
Resets the iterator back to the beginning
|
boolean |
resetSupported()
Is resetting supported by this DataSetIterator?
|
void |
setPreProcessor(DataSetPreProcessor preProcessor)
Set a pre processor
|
int |
totalOutcomes()
The number of labels for the dataset
|
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
getPreProcessor
forEachRemaining
public SequenceRecordReaderDataSetIterator(SequenceRecordReader featuresReader, SequenceRecordReader labels, int miniBatchSize, int numPossibleLabels)
featuresReader
- SequenceRecordReader for the featureslabels
- Labels: assume single value per time step, where values are integers in the range 0 to numPossibleLables-1miniBatchSize
- Minibatch size for each call of next()numPossibleLabels
- Number of classes for the labelspublic SequenceRecordReaderDataSetIterator(SequenceRecordReader featuresReader, SequenceRecordReader labels, int miniBatchSize, int numPossibleLabels, boolean regression)
public SequenceRecordReaderDataSetIterator(SequenceRecordReader featuresReader, SequenceRecordReader labels, int miniBatchSize, int numPossibleLabels, boolean regression, SequenceRecordReaderDataSetIterator.AlignmentMode alignmentMode)
public SequenceRecordReaderDataSetIterator(SequenceRecordReader reader, int miniBatchSize, int numPossibleLabels, int labelIndex)
reader
- SequenceRecordReader with dataminiBatchSize
- size of each minibatchnumPossibleLabels
- number of labels/classes for classificationlabelIndex
- index in input of the label index. If in regression mode and numPossibleLabels > 1, labelIndex denotes the
first index for labels. Everything before that index will be treated as input(s) and
everything from that index (inclusive) to the end will be treated as output(s)public SequenceRecordReaderDataSetIterator(SequenceRecordReader reader, int miniBatchSize, int numPossibleLabels, int labelIndex, boolean regression)
reader
- SequenceRecordReader with dataminiBatchSize
- size of each minibatchnumPossibleLabels
- number of labels/classes for classificationlabelIndex
- index in input of the label index. If in regression mode and numPossibleLabels > 1, labelIndex denotes the
first index for labels. Everything before that index will be treated as input(s) and
everything from that index (inclusive) to the end will be treated as output(s)regression
- Whether output is for regression or classificationpublic DataSet next(int num)
DataSetIterator
next
in interface DataSetIterator
num
- the number of examplespublic int inputColumns()
DataSetIterator
inputColumns
in interface DataSetIterator
public int totalOutcomes()
DataSetIterator
totalOutcomes
in interface DataSetIterator
public boolean resetSupported()
DataSetIterator
resetSupported
in interface DataSetIterator
public boolean asyncSupported()
DataSetIterator
asyncSupported
in interface DataSetIterator
public void reset()
DataSetIterator
reset
in interface DataSetIterator
public int batch()
DataSetIterator
batch
in interface DataSetIterator
public void setPreProcessor(DataSetPreProcessor preProcessor)
DataSetIterator
setPreProcessor
in interface DataSetIterator
preProcessor
- a pre processor to setpublic List<String> getLabels()
DataSetIterator
getLabels
in interface DataSetIterator
public DataSet loadFromMetaData(RecordMetaData recordMetaData) throws IOException
loadFromMetaData(List)
recordMetaData
- RecordMetaData to load from. Should have been produced by the given record readerIOException
- If an error occurs during loading of the datapublic DataSet loadFromMetaData(List<RecordMetaData> list) throws IOException
list
- List of RecordMetaData instances to load from. Should have been produced by the record reader provided
to the SequenceRecordReaderDataSetIterator constructorIOException
- If an error occurs during loading of the dataCopyright © 2020. All rights reserved.