Subject: Re: [htdig] PARTIAL user directory exclusion
From: Geoff Hutchison (email@example.com)
Date: Thu Feb 17 2000 - 12:12:21 PST
On Thu, 17 Feb 2000, Kirby Vandivort wrote:
> The only thing that I have come up with is to do a seperate htdig
> on people.html and tell it to only go to a depth of one. Then, exclude
> people.html from the general search, and merge the two together when
Well, you can either put in a <meta name="robots"
content="follow,noindex"> tag or make a separte text file of the URLs and
include that in a config file.
> and I wanted to merge the two.. would I say?
> htmerge -c no_people.conf -m only_people.conf
Yes. this would work. It would merge only_people.conf into no_people.conf
which sounds like it's what you want.
Williams Students Online
To unsubscribe from the htdig mailing list, send a message to
You will receive a message to confirm this.
This archive was generated by hypermail 2b28 : Thu Feb 17 2000 - 12:15:32 PST