NAME

       Plucene::Analysis::TokenFilter - base class for token filters

DESCRIPTION

       This is an abstract base class for token filters.

       A TokenFilter is a TokenStream whose input is another token stream.

METHODS

   next
       This must be defined in a subclass

   close
       Does nothing.