Re: [htdig] doesn't find words

Subject: Re: [htdig] doesn't find words
From: Geoff Hutchison (
Date: Thu Mar 23 2000 - 15:43:50 PST

At 3:29 PM -0800 3/23/00, dave wrote:
>There are a *lot* of word searches that aren't returning results, what am I

There are a number of possibilities. One that pops to mind quickly is
the bad_words list--if you search for a word in this list, it will be
ignored. Words under the minimum_word_length are also ignored.

Beyond that, it tends to fall into the category of a corrupted or
incomplete database. Several people have pointed out that if you run
out of space while running htmerge, it will probably end up lopping
off part of your db.wordlist and consequently your word database.

There's also the possibility that pages are excluded by noindex
directives or by robots.txt files.

Without more information, it's a bit hard to say. Good questions to
ask are things like "what kinds of word searches aren't returning
results?" (i.e. what words?)

-Geoff Hutchison
Williams Students Online

------------------------------------ To unsubscribe from the htdig mailing list, send a message to You will receive a message to confirm this.

This archive was generated by hypermail 2b28 : Thu Mar 23 2000 - 14:53:41 PST