Re: [htdig3-dev] A proposal for document retrieving with


Gabriele Bartolini (g.bartol@comune.prato.it)
Mon, 04 Oct 1999 18:14:55 +0200


>You're correct in that this could help us gain a lot of time, but it
>depends a bit on the balance of text / large files and the speed of
>the connection. On the one extreme, if there wouldn't have been any
>connections where a HEAD told us to skip the file, then we performed
>two requests for every text connection. :-(
>
>I'd suggest we test it and see if it results in a real-world gain.
>

OK ... I prepared the code in order to allow the tests. I created a static
attribute for HtHTTP class that let us control the way we make HTTP requests.

My process (HEAD + GET eventually) is now set by default, but just by
calling the DisableHeadBeforeGet() it is disabled, and the normal process
(GET) is followed.

I think we can instantiate a configuration option, in the future ...

I may reasonably think that it can work, and that only needs to be deeply
tested.

Ciao
-Gabriele

-------------------------------------------------

Gabriele Bartolini
U.O. Rete Civica - Comune di Prato
Prato - Italia - Europa

e-mail: g.bartol@comune.prato.it
http://www.po-net.prato.it

-------------------------------------------------

------------------------------------
To unsubscribe from the htdig3-dev mailing list, send a message to
htdig3-dev@htdig.org containing the single word "unsubscribe" in
the SUBJECT of the message.



This archive was generated by hypermail 2.0b3 on Mon Oct 04 1999 - 09:20:18 PDT