Package | Description |
---|---|
com.atilika.kuromoji | |
com.atilika.kuromoji.ipadic |
Modifier and Type | Method and Description |
---|---|
abstract <T extends TokenizerBase> |
TokenizerBase.Builder.build()
Creates a Tokenizer instance defined by this Builder
|
Modifier and Type | Class and Description |
---|---|
class |
Tokenizer
A tokenizer based on the IPADIC dictionary
See
Token for details on the morphological features produced by this tokenizer
The following code example demonstrates how to use the Kuromoji tokenizer:
{@code
package com.atilika.kuromoji.example;
import com.atilika.kuromoji.ipadic.Token;
import com.atilika.kuromoji.ipadic.Tokenizer;
import java.util.List;
public class KuromojiExample {
public static void main(String[] args) {
Tokenizer tokenizer = new Tokenizer() ;
List |
Copyright © 2020. All rights reserved.