Class BatchTopCommonTokenCounter


  • public class BatchTopCommonTokenCounter
    extends Object
    Utility class that runs TopCommonTokenCounter against a directory of table files (named {lang}_table.gz or leipzip-like afr_...-sentences.txt) and outputs common tokens files for each input table file in the output directory.
    • Constructor Detail

      • BatchTopCommonTokenCounter

        public BatchTopCommonTokenCounter()