[htdig3-dev] A proposal for document retrieving with HTTP/1.1


loic@ceic.com
Mon, 4 Oct 1999 13:59:46 +0200 (MEST)


Gabriele Bartolini writes:
> buffer to zero. I pray you to try the testnet program under the test dir
> with a redirected URL.

 I wish to do that. It will be easy for me because I know how the test
directory is architectured. It will be harder for others. Could you
write a small t_htnet containing a test for this, even if for nothing else ?

> HTTP/1.1 seems to work now, but it needs improvements, obviously.
>
> I have a proposal to do. Since we take advantage of persistent connections
> I want to implement these steps for each request:
>
> 1) If we have any informations on the server (it's already been asked for a
> document) and we know it doesn't accepts persistent connections, we can
> disable them for the request.
>
> 2) If persistent connections are available, I suggest to make a HEAD
> request before the GET one. This will permit us to check both the response
> status code and the content-type. And we can check if the document has

 And provide fallback for emulating HEAD with GET for servers that do not
implement HEAD (there are such servers although I could not say which).
Emulating HEAD is easy : GET + trunc the connection after reading header.

> Just let me know what you think about it, so I can modify the code this way
> ..

 I think it's very good. You have my vote :-)

-- 
		Loic Dachary

ECILA 100 av. du Gal Leclerc 93500 Pantin - France Tel: 33 1 56 96 09 80, Fax: 33 1 56 96 09 61 e-mail: Loic@Dachary.org URL: http://www.senga.org/

------------------------------------ To unsubscribe from the htdig3-dev mailing list, send a message to htdig3-dev@htdig.org containing the single word "unsubscribe" in the SUBJECT of the message.



This archive was generated by hypermail 2.0b3 on Mon Oct 04 1999 - 04:53:25 PDT