| Package | Description |
|---|---|
| org.datavec.hadoop.records.reader.mapfile | |
| org.datavec.hadoop.records.reader.mapfile.index |
| Constructor and Description |
|---|
MapFileReader(List<String> paths,
IndexToKey indexToKey,
Class<? extends org.apache.hadoop.io.Writable> recordClass) |
MapFileReader(String path,
IndexToKey indexToKey,
Class<? extends org.apache.hadoop.io.Writable> recordClass) |
MapFileRecordReader(IndexToKey indexToKey,
Random rng)
Create a MapFileRecordReader with optional randomisation, with a custom
IndexToKey instance to
handle MapFile keys |
MapFileSequenceRecordReader(IndexToKey indexToKey,
Random rng)
Create a MapFileSequenceRecordReader with optional randomisation, with a custom
IndexToKey instance to
handle MapFile keys |
| Modifier and Type | Class and Description |
|---|---|
class |
LongIndexToKey
A default implementation of
IndexToKey that assumes (strictly requires) keys that are
LongWritable values, where all values are both unique and contiguous (0 to numRecords()-1)This allows for easy inference of the number of records, and identify mapping between indexes and keys. |
Copyright © 2020. All rights reserved.