Re: [htdig3-dev] max_docs per url, not per server


Subject: Re: [htdig3-dev] max_docs per url, not per server
From: Geoff Hutchison (ghutchis@wso.williams.edu)
Date: Tue May 09 2000 - 13:51:43 PDT


yOn Tue, 9 May 2000, Nico Tranquilli wrote:

> Is it possibile to limit htdig to retrieve a maximum number of documents
> from each *url* (something similiar to server_max_docs).
> Any url_max_docs in the todo list ?

Sort of. The new configuration code in 3.2 allows per-url and per-server
attributes to be defined. Many of them are not "switched on," so only a
few of the attributes can be set on this basis.

I believe server_max_docs does work in a server context in the current 3.2
tree.

That said, there haven't been any plans for a url context for it. It would
be possible, but it would be a bit difficult to implement. The per-server
restirction is easy because there's a Server object that keeps track of
the URLs to fetch. So it keeps a counter and stops when it hits the limit.

It would be possible to do a url pattern limit, but this wouldn't be as
easy as the server one.

-Geoff

------------------------------------
To unsubscribe from the htdig3-dev mailing list, send a message to
htdig3-dev-unsubscribe@htdig.org
You will receive a message to confirm this.



This archive was generated by hypermail 2b28 : Tue May 09 2000 - 11:39:13 PDT