Subject: Re: [htdig3-dev] HEAD before GET to allow exclusion by MIME content-type
From: Geoff Hutchison (email@example.com)
Date: Wed Feb 02 2000 - 08:05:27 PST
On Wed, 2 Feb 2000, Gilles Detillieux wrote:
> > type returned in the HTTP header. Of course to do this would mean
> > sending a HEAD request first, and then only a GET if the content-type is
> > one we can index. Of course this has a significant latency impact, but
> > we can live with that.
> In 3.2, htdig will support persistant connections and head before get as
> options. I haven't taken the time to get familiar with the new code, but
> it does seem to detect and reject documents that are "not parsable".
I'll echo Gilles's comments here, the 3.2.0b1 beta will have a
head_before_get attribute, which I believe will do what you want.
To unsubscribe from the htdig3-dev mailing list, send a message to
You will receive a message to confirm this.
This archive was generated by hypermail 2b28 : Wed Feb 02 2000 - 08:07:08 PST