| Package | Description |
|---|---|
| com.atilika.kuromoji | |
| com.atilika.kuromoji.ipadic | |
| com.atilika.kuromoji.viterbi |
| Modifier and Type | Method and Description |
|---|---|
protected <T extends TokenBase> |
TokenizerBase.createTokenList(String text)
Tokenizes the provided text and returns a list of tokens with various feature information
This method is thread safe
|
| Modifier and Type | Method and Description |
|---|---|
List<? extends TokenBase> |
TokenizerBase.tokenize(String text) |
| Modifier and Type | Class and Description |
|---|---|
class |
Token
IPADIC token produced by the IPADIC tokenizer with various morphological features
|
| Modifier and Type | Interface and Description |
|---|---|
interface |
TokenFactory<T extends TokenBase> |
Copyright © 2020. All rights reserved.