Uses of Package
org.apache.tika.eval.core.tokens
Packages that use org.apache.tika.eval.core.tokens
-
Classes in org.apache.tika.eval.core.tokens used by org.apache.tika.eval.core.textstatsClassDescriptionManages tokenization for tika-eval.Lazily loads the per-language "common tokens" Bloom filters (see
CommonTokensBloom) from the classpath (/common_tokens_bloom/<langCode>) or from a configured directory. -
Classes in org.apache.tika.eval.core.tokens used by org.apache.tika.eval.core.tokensClassDescriptionManages tokenization for tika-eval.The set of "common tokens" for a single language, backed by a Bloom filter.Tokenization mode.