NAME

       slmseg - maximum matching segment Chinese text.

SYNOPSIS

       slmseg -d dict_file [option]... [corpus_file]...

DESCRIPTION

       slmseg is a tool for segmenting Chinese text into words using maximum matching algorithm.
       slmseg segments corpus_file, or standard input if no filename is specified, and write the
       segmented result to standard output.

OPTIONS

       -d dict_file
           Use dict_file as lexicon. A default lexicon can be found at
           /usr/share/sunpinyin-slm/dict.utf8.

       -f,--format (text|bin)
           Output Format, can be 'text' or 'bin'. default 'bin'.  Normally, in text mode, word
           text are output, while in binary mode, binary short integer of the word-ids are
           written to stdout.

       -s, --stok STOK_ID
           Sentence token id. Default 10.  It will be written to output in binary mode after
           every sentence.

       -i, --show-id
           Show Id info. Under text output format mode, attach id after known words.  If under
           binary mode, print id(s) in text.

       -m, --model language-model-file Speficy the language model file. This file is always
       generated by slmthread.

NOTES

       Under binary mode, consecutive id of 0 are merged into one 0.  Under text mode, no space
       are inserted between unknown-words.

AUTHOR

       Originally written by Phill.Zhang <phill.zhang@sun.com>.  Currently maintained by Kov.Chai
       <tchaikov@gmail.com>.

SEE ALSO

       mmseg(1), ids2ngram (1).