[htdig] Excluding URLs with the ? query string character

Subject: [htdig] Excluding URLs with the ? query string character
From: Manuel Lemos (mlemos@acm.org)
Date: Sat Feb 05 2000 - 16:52:58 PST


Is there a way to exclude URLs in the search that contain ? query string
character like most crawlers do?

For instance this URL would not be indexed:


But this would be indexed


If it is not possible, could I at least exclude those URLs from the search

Manuel Lemos

Web Programming Components using PHP Classes.
Look at: mlemos@acm.org">http://phpclasses.UpperDesign.com/?user=mlemos@acm.org

E-mail: mlemos@acm.org
URL: http://www.mlemos.e-na.net/
PGP key: http://www.mlemos.e-na.net/ManuelLemos.pgp

------------------------------------ To unsubscribe from the htdig mailing list, send a message to htdig-unsubscribe@htdig.org You will receive a message to confirm this.

This archive was generated by hypermail 2b28 : Sat Feb 05 2000 - 17:02:27 PST