Package org.apache.tika.eval.core.tokens

package org.apache.tika.eval.core.tokens

Class	Description
AnalyzerManager	Manages tokenization for tika-eval.
CommonTokenCountManager
CommonTokenResult
ContrastStatistics
LangModel
TikaEvalTokenizer	Tokenizer for tika-eval text analysis.
TikaEvalTokenizer.Mode	Tokenization mode.
TokenContraster	Computes some corpus contrast statistics.
TokenCountPriorityQueue	Bounded min-heap that keeps the top-N TokenIntPairs by value.
TokenCounts
TokenIntPair
TokenStatistics