RE: [htdig] Indexing stops after 100-200 documents

Subject: RE: [htdig] Indexing stops after 100-200 documents
From: Geoff Hutchison (
Date: Tue Sep 19 2000 - 05:48:30 PDT

At 11:29 AM +0200 9/19/00, Martin Mielke wrote:
>playing around with the conf file, a trailing slash at the end of start_url
>solved the issue:
> 1. start_url: http://intranet/ --> fails to index documents
> 2. start_url: http://intranet --> indexes everything! :-)

It sounds like there's a strange problem with redirects. Normally
servers would redirect from a directory w/o a slash to the correct
URL. i.e.: ->

If your webserver isn't doing this correctly you can sometimes get
weird results with relative pathnames.

-Geoff Hutchison
Williams Students Online

------------------------------------ To unsubscribe from the htdig mailing list, send a message to You will receive a message to confirm this. List archives: <> FAQ: <>

This archive was generated by hypermail 2b28 : Tue Sep 19 2000 - 05:54:21 PDT