Provided by: libplucene-perl_1.25-5_all
NAME
Plucene::Analysis::WhitespaceTokenizer - white space tokenizer
SYNOPSIS
# isa Plucene::Analysis::CharTokenizer
DESCRIPTION
A WhitespaceTokenizer is a tokenizer that divides text at whitespace. Adjacent sequences of non-Whitespace characters form tokens.