Package org.apache.tika.eval.core.tokens

Class AlphaIdeographFilterFactory

java.lang.Object
org.apache.lucene.analysis.AbstractAnalysisFactory
org.apache.lucene.analysis.TokenFilterFactory
org.apache.tika.eval.core.tokens.AlphaIdeographFilterFactory
public class AlphaIdeographFilterFactory extends org.apache.lucene.analysis.TokenFilterFactory
Factory for filter that only allows tokens with characters that "isAlphabetic" or "isIdeographic" through.

  • Field Summary

    Fields
    Modifier and Type
    Field
    Description
    static final String
    NAME
     

    Fields inherited from class org.apache.lucene.analysis.AbstractAnalysisFactory

    LUCENE_MATCH_VERSION_PARAM, luceneMatchVersion

  • Constructor Summary

    Constructors
    Constructor
    Description
    AlphaIdeographFilterFactory()
     
    AlphaIdeographFilterFactory(Map<String,String> args)
     

  • Method Summary

    Modifier and Type
    Method
    Description
    org.apache.lucene.analysis.TokenStream
    create(org.apache.lucene.analysis.TokenStream tokenStream)
     
    static boolean
    isAlphabetic(char[] token, int length)
     

    Methods inherited from class org.apache.lucene.analysis.TokenFilterFactory

    availableTokenFilters, findSPIName, forName, lookupClass, normalize, reloadTokenFilters

    Methods inherited from class org.apache.lucene.analysis.AbstractAnalysisFactory

    defaultCtorException, get, get, get, get, get, getBoolean, getChar, getClassArg, getFloat, getInt, getLines, getLuceneMatchVersion, getOriginalArgs, getPattern, getSet, getSnowballWordSet, getWordSet, isExplicitLuceneMatchVersion, require, require, require, requireBoolean, requireChar, requireFloat, requireInt, setExplicitLuceneMatchVersion, splitAt, splitFileNames

    Methods inherited from class java.lang.Object

    clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

  • Field Details

  • Constructor Details

    • AlphaIdeographFilterFactory

      public AlphaIdeographFilterFactory()

    • AlphaIdeographFilterFactory

      public AlphaIdeographFilterFactory(Map<String,String> args)

  • Method Details

    • isAlphabetic

      public static boolean isAlphabetic(char[] token, int length)

    • create

      public org.apache.lucene.analysis.TokenStream create(org.apache.lucene.analysis.TokenStream tokenStream)
      Specified by:
      create in class org.apache.lucene.analysis.TokenFilterFactory