NAME

       Plucene::Analysis::Analyzer - base class for Analyzers

SYNOPSIS

               my $analyzer = Plucene::Analysis::Analyzer::Subclass->new;

DESCRIPTION

       This is an abstract base class of Analyzers.

       An Analyzer builds TokenStreams, which analyze text. It thus represents a policy for
       extracting index terms from text.

       Typical implementations first build a Tokenizer, which breaks the stream of characters
       from the Reader into raw Tokens. One or more TokenFilters may then be applied to the
       output of the Tokenizer.

METHODS

   new
               my $analyzer = Plucene::Analysis::Analyzer::Subclass->new;

   tokenstream
       This must be defined in a subclass