public class SparkWord2Vec extends SparkSequenceVectors<VocabWord>
| Modifier and Type | Class and Description |
|---|---|
static class |
SparkWord2Vec.Builder |
SequenceVectors.AsyncSequencerconfigurationBroadcast, ela, elementsFreqAccum, elementsFreqAccumExtra, exporter, isAutoDiscoveryMode, isEnvironmentReady, paramServerConfiguration, shallowVocabCache, shallowVocabCacheBroadcast, sla, storageLevel, vocabCacheBroadcastconfiguration, configured, elementsLearningAlgorithm, enableScavenger, eventListeners, existingModel, iterator, log, scoreElements, scoreSequences, sequenceLearningAlgorithm, unknownElement, vocabLimitbatchSize, DEFAULT_UNK, layerSize, learningRate, learningRateDecayWords, lookupTable, minLearningRate, minWordFrequency, modelUtils, negative, numEpochs, numIterations, resetModel, sampling, seed, stopWords, trainElementsVectors, trainSequenceVectors, useAdeGrad, useUnknown, variableWindows, vocab, window, workers| Modifier | Constructor and Description |
|---|---|
protected |
SparkWord2Vec() |
|
SparkWord2Vec(VoidConfiguration psConfiguration,
VectorsConfiguration configuration) |
| Modifier and Type | Method and Description |
|---|---|
void |
fit()
Deprecated.
|
void |
fitSentences(org.apache.spark.api.java.JavaRDD<java.lang.String> sentences) |
protected VocabCache<ShallowSequenceElement> |
getShallowVocabCache() |
protected void |
validateConfiguration() |
broadcastEnvironment, buildShallowVocabCache, fitLists, fitSequences, getCounterbuildVocab, getElementsScore, getSequencesScore, getUNK, getWordVectorMatrix, initLearners, setUNK, trainSequenceaccuracy, getLayerSize, getWordVector, getWordVectorMatrixNormalized, getWordVectors, getWordVectorsMean, hasWord, indexOf, lookupTable, setLookupTable, setModelUtils, setVocab, similarity, similarWordsInVocabTo, update, update, vocab, wordsNearest, wordsNearest, wordsNearest, wordsNearestSum, wordsNearestSum, wordsNearestSumclone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, waitaccuracy, getWordVector, getWordVectorMatrixNormalized, getWordVectors, getWordVectorsMean, hasWord, indexOf, lookupTable, setModelUtils, similarity, similarWordsInVocabTo, vocab, wordsNearest, wordsNearest, wordsNearest, wordsNearestSum, wordsNearestSum, wordsNearestSumprotected SparkWord2Vec()
public SparkWord2Vec(@NonNull
VoidConfiguration psConfiguration,
@NonNull
VectorsConfiguration configuration)
protected VocabCache<ShallowSequenceElement> getShallowVocabCache()
getShallowVocabCache in class SparkSequenceVectors<VocabWord>protected void validateConfiguration()
validateConfiguration in class SparkSequenceVectors<VocabWord>@Deprecated public void fit()
fit in class SparkSequenceVectors<VocabWord>public void fitSentences(org.apache.spark.api.java.JavaRDD<java.lang.String> sentences)