Package org.apache.tika.eval.core.tokens
Class CommonTokenResult
java.lang.Object
org.apache.tika.eval.core.tokens.CommonTokenResult
-
Constructor Summary
ConstructorDescriptionCommonTokenResult
(String langCode, int uniqueCommonTokens, int commonTokens, int uniqueAlphabeticTokens, int alphabeticTokens) -
Method Summary
-
Constructor Details
-
CommonTokenResult
public CommonTokenResult(String langCode, int uniqueCommonTokens, int commonTokens, int uniqueAlphabeticTokens, int alphabeticTokens)
-
-
Method Details
-
getLangCode
- Returns:
- the language used to select the common_tokens list
-
getCommonTokens
public int getCommonTokens()- Returns:
- total number of "common tokens"
-
getUniqueCommonTokens
public int getUniqueCommonTokens()- Returns:
- number of unique "common tokens" (types)
-
getUniqueAlphabeticTokens
public int getUniqueAlphabeticTokens()- Returns:
- number of unique alphabetic tokens (types)
-
getAlphabeticTokens
public int getAlphabeticTokens()- Returns:
- number of tokens that had at least one alphabetic/ideographic character whether or not a common token
-
getOOV
public double getOOV()
-