Package org.apache.tika.eval.core.tokens
Class CommonTokenCountManager
java.lang.Object
org.apache.tika.eval.core.tokens.CommonTokenCountManager
-
Constructor Summary
Constructors -
Method Summary
Modifier and TypeMethodDescriptionvoid
close()
countTokenOverlaps
(String langCode, Map<String, org.apache.commons.lang3.mutable.MutableInt> tokens) Deprecated.getLangs()
getLangTokens
(String lang)
-
Constructor Details
-
CommonTokenCountManager
public CommonTokenCountManager() -
CommonTokenCountManager
-
-
Method Details
-
countTokenOverlaps
@Deprecated public CommonTokenResult countTokenOverlaps(String langCode, Map<String, org.apache.commons.lang3.mutable.MutableInt> tokens) throws IOExceptionDeprecated.- Throws:
IOException
-
getTokens
-
getLangs
-
getLangTokens
- Parameters:
lang
-- Returns:
- pair of actual language code used and a set of common tokens for that language
-
close
- Throws:
IOException
-