Package | Description |
---|---|
com.atilika.kuromoji | |
com.atilika.kuromoji.ipadic | |
com.atilika.kuromoji.viterbi |
Modifier and Type | Method and Description |
---|---|
protected <T extends TokenBase> |
TokenizerBase.createTokenList(String text)
Tokenizes the provided text and returns a list of tokens with various feature information
This method is thread safe
|
Modifier and Type | Method and Description |
---|---|
List<? extends TokenBase> |
TokenizerBase.tokenize(String text) |
Modifier and Type | Class and Description |
---|---|
class |
Token
IPADIC token produced by the IPADIC tokenizer with various morphological features
|
Modifier and Type | Interface and Description |
---|---|
interface |
TokenFactory<T extends TokenBase> |
Copyright © 2020. All rights reserved.