public final class ChineseTokenizer
extends org.apache.lucene.analysis.Tokenizer
Title: ChineseTokenizer
Description: Extract tokens from the Stream using Character.getType()
Rule: A Chinese character as a single token
Copyright: Copyright (c) 2001
Company:
Version:
1.0
Author:
Yiyi Sun
Field Summary
Fields inherited from class org.apache.lucene.analysis.Tokenizer