httpindex(1)                                 General Commands Manual                                httpindex(1)

NAME

       httpindex - HTTP front-end for SWISH++ indexer

SYNOPSIS

       wget [ options ] URL...  2>&1 | httpindex [ options ]

DESCRIPTION

       httpindex  is  a  front-end  for index++(1) to index files copied from remote servers using wget(1).  The
       files (in a copy of the remote directory  structure)  can  be  kept,  deleted,  or  replaced  with  their
       descriptions after indexing.

OPTIONS

   wget Options
       The wget(1) options that are required are: -A, -nv, -r, and -x; the ones that are highly recommended are:
       -l, -nh, -t, and -w.  (See the EXAMPLE.)

   httpindex Options
       httpindex accepts the same short options as index++(1) except for -H, -I, -l, -r, -S, and -V.

       The following options are unique to httpindex:

       -d     Replace the text of local copies of retrieved files with their descriptions after they  have  been
              indexed.   This  is  useful  to display file descriptions in search results without having to have
              complete copies of the remote files thus saving filesystem space.  (See the  extract_description()
              function in WWW(3) for details about how descriptions are extracted.)

       -D     Delete the local copies of retrieved files after they have been indexed.  This prevents your local
              filesystem from filling up with copies of remote files.

EXAMPLE

       To index all HTML and text files on a remote web server keeping descriptions locally:

            wget -A html,txt -linf -t2 -rxnv -nh -w2 http://www.foo.com 2>&1 |
            httpindex -d -e'html:*.html,text:*.txt'

       Note that you need to redirect wget(1)'s output from standard error to standard output in order  to  pipe
       it to httpindex.

EXIT STATUS

       Exits with a value of zero only if indexing completed sucessfully; non-zero otherwise.

CAVEATS

       In  addition to those for index++(1), httpindex does not correctly handle the use of multiple -e, -E, -m,
       or -M options (because the Perl script uses the standard GetOpt::Std package for processing  command-line
       options that doesn't).  The last of any of those options ``wins.''

       The  work-around is to use multiple values for those options seperated by commas to a single one of those
       options.  For example, if you want to do:

            httpindex -e'html:*.html' -e'text:*.txt'

       do this instead:

            httpindex -e'html:*.html,text:*.txt'

SEE ALSO

       index++(1), wget(1), WWW(3)

AUTHOR

       Paul J. Lucas <pauljlucas@mac.com>

SWISH++                                          August 2, 2005                                     httpindex(1)