bionic (1) ngramperplexity.1.gz

NAME

       ngramperplexity - Apply n-gram model to input fst archive.

DESCRIPTION

       Apply n-gram model to input fst archive.

SYNOPSIS

       ngramperplexity [--options] ngram.fst [in.far [out.txt]]

OPTIONS

       --OOV_class_size: type = double, default = 10000

              Number of members of OOV class

       --OOV_probability: type = double, default = 0

              Unigram probability for OOVs

       --OOV_symbol: type = string, default = ""

              Existing symbol for OOV class

       --context_pattern: type = string, default = ""

              Restrict perplexity computation to contexts defined by pattern (default: no restriction)

       --use_phimatcher: type = bool, default = false

              Use phi matcher and composition

       --help: type = bool, default = false

              show usage information

       --helpshort: type = bool, default = false

              show brief usage information

       --tmpdir: type = string, default = "/tmp"

              temporary directory

       --v: type = int32, default = 0

              verbosity level

       --fst_align: type = bool, default = false

              Write FST data aligned where appropriate

       --fst_default_cache_gc: type = bool, default = true

              Enable garbage collection of cache

       --fst_default_cache_gc_limit: type = int64, default = 1048576

              Cache byte size that triggers garbage collection

       --fst_read_mode: type = string, default = "read"

              Default file reading mode for mappable files

       --fst_verify_properties: type = bool, default = false

              Verify FST properties queried by TestProperties

       --save_relabel_ipairs: type = string, default = ""

              Save input relabel pairs to file

       --save_relabel_opairs: type = string, default = ""

              Save output relabel pairs to file

       --end_symbol: type = string, default = "</s>"

              Class label for sentence start

       --start_symbol: type = string, default = "<s>"

              Class label for sentence start

       --fst_compat_symbols: type = bool, default = true

              Require symbol tables to match when appropriate

       --fst_field_separator: type = string, default = "      "

              Set of characters used as a separator between printed fields

       --fst_error_fatal: type = bool, default = true

              FST  errors  are  fatal;  o.w. return objects flagged as bad: e.g., FSTs: kError property set, FST
              weights: not a Member()

       --ngram_error_fatal: type = bool, default = true

              NGram errors are fatal; o.w. return objects flagged as  bad:   e.g.,  NGramModel::Error()  returns
              true.

       --fst_weight_parentheses: type = string, default = ""

              Characters  enclosing  the  first  weight  of a printed composite weight (e.g., pair weight, tuple
              weight and derived classes) to ensure proper I/O of nested composite weights;  must  have  size  0
              (none) or 2 (open and close parenthesis)

       --fst_weight_separator: type = string, default = ","

              Character separator between printed composite weights; must be a single character