Re: [htdig] Link Limits?


Subject: Re: [htdig] Link Limits?
From: Geoff Hutchison (ghutchis@wso.williams.edu)
Date: Tue Mar 07 2000 - 19:16:36 PST


On Tue, 7 Mar 2000, Brandon Bell wrote:

> Are there any limits in place for the number of links followed on a
> page? I'm asking the question because only about 1300 of my ~1500

If you've set max_doc_size and you aren't running out of memory, there's
no limit. One thing you can try is adding a -vvv to the command line and
taking a look at the messages generated when htdig encounters the links
(i.e. are they being rejected) and when it tries to index the pages
themselves.

-Geoff Hutchison
Williams Students Online
http://wso.williams.edu/

------------------------------------
To unsubscribe from the htdig mailing list, send a message to
htdig-unsubscribe@htdig.org
You will receive a message to confirm this.



This archive was generated by hypermail 2b28 : Tue Mar 07 2000 - 19:21:24 PST