Re: [htdig] Page ignored!

Subject: Re: [htdig] Page ignored!
From: Geoff Hutchison (
Date: Tue Dec 21 1999 - 06:30:05 PST

On Tue, 21 Dec 1999, Paul Key wrote:

> However when I search for text I know is contained in this
> page the page is not returned by the search.
> Any ideas where I am going wrong and how I can include this
> page in my search?

The first question is whether or not the page was *indexed*. You might try
indexing using htdig -v and take a look at the list of URLs that come out.

Does this page have a META noindex tag (or does the site have a robots.txt

-Geoff Hutchison
Williams Students Online

To unsubscribe from the htdig mailing list, send a message to
You will receive a message to confirm this.

This archive was generated by hypermail 2b28 : Tue Dec 21 1999 - 06:44:36 PST