org.apache.tika.eval.core.tokens

Class AlphaIdeographFilterFactory

java.lang.Object

org.apache.lucene.analysis.util.AbstractAnalysisFactory

org.apache.lucene.analysis.util.TokenFilterFactory

org.apache.tika.eval.core.tokens.AlphaIdeographFilterFactory

public class AlphaIdeographFilterFactory
extends org.apache.lucene.analysis.util.TokenFilterFactory

Factory for filter that only allows tokens with characters that "isAlphabetic" or "isIdeographic" through.

Field Summary

Fields inherited from class org.apache.lucene.analysis.util.AbstractAnalysisFactory

LUCENE_MATCH_VERSION_PARAM, luceneMatchVersion

Constructor Summary

Constructors

Constructor and Description
AlphaIdeographFilterFactory(Map<String,String> args)

Method Summary

Modifier and Type	Method and Description
org.apache.lucene.analysis.TokenStream	create(org.apache.lucene.analysis.TokenStream tokenStream)
static boolean	isAlphabetic(char[] token, int length)

Methods inherited from class org.apache.lucene.analysis.util.TokenFilterFactory

availableTokenFilters, findSPIName, forName, lookupClass, normalize, reloadTokenFilters

Methods inherited from class org.apache.lucene.analysis.util.AbstractAnalysisFactory

get, get, get, get, get, getBoolean, getChar, getClassArg, getFloat, getInt, getLines, getLuceneMatchVersion, getOriginalArgs, getPattern, getSet, getSnowballWordSet, getWordSet, isExplicitLuceneMatchVersion, require, require, require, requireBoolean, requireChar, requireFloat, requireInt, setExplicitLuceneMatchVersion, splitAt, splitFileNames

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

AlphaIdeographFilterFactory

public AlphaIdeographFilterFactory(Map<String,String> args)

Method Detail

isAlphabetic

public static boolean isAlphabetic(char[] token,
                                   int length)

create

public org.apache.lucene.analysis.TokenStream create(org.apache.lucene.analysis.TokenStream tokenStream)

Specified by:

create in class org.apache.lucene.analysis.util.TokenFilterFactory