Creates a Tokenizer instance defined by this Builder

A tokenizer based on the IPADIC dictionary See Token for details on the morphological features produced by this tokenizer The following code example demonstrates how to use the Kuromoji tokenizer: {@code package com.atilika.kuromoji.example; import com.atilika.kuromoji.ipadic.Token; import com.atilika.kuromoji.ipadic.Tokenizer; import java.util.List; public class KuromojiExample { public static void main(String[] args) { Tokenizer tokenizer = new Tokenizer() ; List tokens = tokenizer.tokenize("お寿司が食べたい。")