RE: [htdig] Indexing stops after 100-200 documents


Subject: RE: [htdig] Indexing stops after 100-200 documents
From: Geoff Hutchison (ghutchis@wso.williams.edu)
Date: Tue Sep 19 2000 - 05:48:30 PDT


At 11:29 AM +0200 9/19/00, Martin Mielke wrote:
>playing around with the conf file, a trailing slash at the end of start_url
>solved the issue:
>
> 1. start_url: http://intranet/ --> fails to index documents
> 2. start_url: http://intranet --> indexes everything! :-)

It sounds like there's a strange problem with redirects. Normally
servers would redirect from a directory w/o a slash to the correct
URL. i.e.:

http://www.htdig.org -> http://www.htdig.org/

If your webserver isn't doing this correctly you can sometimes get
weird results with relative pathnames.

--
-Geoff Hutchison
Williams Students Online
http://wso.williams.edu/

------------------------------------ To unsubscribe from the htdig mailing list, send a message to htdig-unsubscribe@htdig.org You will receive a message to confirm this. List archives: <http://www.htdig.org/mail/menu.html> FAQ: <http://www.htdig.org/FAQ.html>



This archive was generated by hypermail 2b28 : Tue Sep 19 2000 - 05:54:21 PDT