[htdig] unix directory index duplication


Subject: [htdig] unix directory index duplication
From: pc (tgm@cshore.com)
Date: Tue Jan 02 2001 - 18:27:48 PST


While watching verbore output during htdig, I noticed that the process is
often processing urls like http:/foo.bar/doc/?M=D, http:/foo.bar/doc/?D=A,
http:/foo.bar/doc/?N=A, and http:/foo.bar/doc/?N=D. This appears to be
creating a significant amount of duplication and I would like to prevent
this from happening. Is there a fix or some other config option I need to
deal with? Thanks in advance. Tim

------------------------------------
To unsubscribe from the htdig mailing list, send a message to
htdig-unsubscribe@htdig.org
You will receive a message to confirm this.
List archives: <http://www.htdig.org/mail/menu.html>
FAQ: <http://www.htdig.org/FAQ.html>



This archive was generated by hypermail 2b28 : Tue Jan 02 2001 - 18:39:30 PST