Re: [htdig] Features of HtDig


Subject: Re: [htdig] Features of HtDig
From: Torsten Neuer (tneuer@inwise.de)
Date: Tue Nov 30 1999 - 00:29:23 PST


Geoff Hutchison wrote:
>
> >2) Does Htdig support "Stop Words", or as I understand: When Htdig hits a
> >word in a stop
> >word list it will stop indexing the individual page.
>
> Not to that extent. I've mostly heard the terms "stop words" to refer
> to words that should be ignored from searches or indexing. It does
> this. See <http://www.htdig.org/attrs.html#bad_words_list>

This is quite common misunderstanding of the term "stop word" ;-)

However, page indexing can be controlled by either robots exclusion
standards
(i.e. "robots" meta tag) or <--htdig_noindex--> ... <--/htdig_noindex-->
comments inside of documents. The latter is probably what Brett is
looking
for.
 

cheers,
  Torsten

-- 
InWise - Wirtschaftlich-Wissenschaftlicher Internet Service GmbH
Waldhofstraße 14                            Tel: +49-4101-403605
D-25474 Ellerbek                            Fax: +49-4101-403606
E-Mail: info@inwise.de            Internet: http://www.inwise.de

------------------------------------ To unsubscribe from the htdig mailing list, send a message to htdig-unsubscribe@htdig.org You will receive a message to confirm this.



This archive was generated by hypermail 2b25 : Tue Nov 30 1999 - 00:43:14 PST