Package org.apache.tika.ml.junkdetect

package org.apache.tika.ml.junkdetect

Related Packages

Package	Description
org.apache.tika.ml
org.apache.tika.ml.junkdetect.tools
org.apache.tika.ml.chardetect

Class	Description
BigramTables	Carrier for one script's codepoint-bigram tables.
HtmlContentCleaner	Junk-detection HTML→text cleaning: strip tags, then expand entities to codepoints.
JunkDetector	Language-agnostic text quality scorer.
JunkDetector.BigramSink	Sink for JunkDetector.forEachScriptBigram(int[], JunkDetector.BigramSink): (modelScript, cpA, cpB).
JunkDetector.FeatureComponents	Per-feature z-score breakdown returned by JunkDetector.scoreWithFeatureComponents(String).
JunkFilterEncodingDetector	A MetaEncodingDetector that arbitrates charset candidates by asking a TextQualityDetector which decoded candidate looks most like natural text.
TextQualityFeatures	Candidate charset-agnostic features for use in the Phase-2 feature study (see plan wild-roaming-whale).
TextQualityFeatures.StripMode
UnicodeBlockRanges	Static codepoint-range → bucket-index lookup table used by Feature 2 (block-transition log-probability).