Re: [htdig3-dev] HEAD before GET to allow exclusion by MIME content-type


Subject: Re: [htdig3-dev] HEAD before GET to allow exclusion by MIME content-type
From: Geoff Hutchison (ghutchis@wso.williams.edu)
Date: Wed Feb 02 2000 - 08:05:27 PST


On Wed, 2 Feb 2000, Gilles Detillieux wrote:

> > type returned in the HTTP header. Of course to do this would mean
> > sending a HEAD request first, and then only a GET if the content-type is
> > one we can index. Of course this has a significant latency impact, but
> > we can live with that.
>
> In 3.2, htdig will support persistant connections and head before get as
> options. I haven't taken the time to get familiar with the new code, but
> it does seem to detect and reject documents that are "not parsable".

I'll echo Gilles's comments here, the 3.2.0b1 beta will have a
head_before_get attribute, which I believe will do what you want.

Cheers,
-Geoff

------------------------------------
To unsubscribe from the htdig3-dev mailing list, send a message to
htdig3-dev-unsubscribe@htdig.org
You will receive a message to confirm this.



This archive was generated by hypermail 2b28 : Wed Feb 02 2000 - 08:07:08 PST