Package org.apache.tika.eval.tokens

Class AlphaIdeographFilterFactory

  • public class AlphaIdeographFilterFactory
extends org.apache.lucene.analysis.util.TokenFilterFactory
    Factory for filter that only allows tokens with characters that "isAlphabetic" or "isIdeographic" through.

    • Field Summary

      • Fields inherited from class org.apache.lucene.analysis.util.AbstractAnalysisFactory

        LUCENE_MATCH_VERSION_PARAM, luceneMatchVersion

    • Method Summary

      All Methods Static Methods Instance Methods Concrete Methods 
      Modifier and Type Method Description
      org.apache.lucene.analysis.TokenStream create​(org.apache.lucene.analysis.TokenStream tokenStream)  
      static boolean isAlphabetic​(char[] token, int length)  

      • Methods inherited from class org.apache.lucene.analysis.util.TokenFilterFactory

        availableTokenFilters, findSPIName, forName, lookupClass, normalize, reloadTokenFilters

      • Methods inherited from class org.apache.lucene.analysis.util.AbstractAnalysisFactory

        get, get, get, get, get, getBoolean, getChar, getClassArg, getFloat, getInt, getLines, getLuceneMatchVersion, getOriginalArgs, getPattern, getSet, getSnowballWordSet, getWordSet, isExplicitLuceneMatchVersion, require, require, require, requireBoolean, requireChar, requireFloat, requireInt, setExplicitLuceneMatchVersion, splitAt, splitFileNames

    • Constructor Detail

      • AlphaIdeographFilterFactory

        public AlphaIdeographFilterFactory​(Map<String,​String> args)

    • Method Detail

      • create

        public org.apache.lucene.analysis.TokenStream create​(org.apache.lucene.analysis.TokenStream tokenStream)
        Specified by:
        create in class org.apache.lucene.analysis.util.TokenFilterFactory

      • isAlphabetic

        public static boolean isAlphabetic​(char[] token,
                                   int length)