[htdig] exclude documents, but still index links on it?


Subject: [htdig] exclude documents, but still index links on it?
From: John Caldwell (jcald@veedub.nu)
Date: Wed Jan 05 2000 - 16:48:49 PST


I'm working on a site with some dynamic content, and i want to be able to
point htdig at an index of pages so that it can spider them, but I don't
want the main index page to ever show up in the search results. Is there
way to 'exclude' a file but still follow the links on it?

--
John Caldwell
jcald@veedub.nu

------------------------------------ To unsubscribe from the htdig mailing list, send a message to htdig-unsubscribe@htdig.org You will receive a message to confirm this.



This archive was generated by hypermail 2b28 : Wed Jan 05 2000 - 16:13:54 PST