Re: [htdig] how to search sub directories


Marcin Owsiany (porridge@lo4.ids.bielsko.pl)
Fri, 9 Jul 1999 20:43:30 +0200


On Fri, Jul 09, 1999 at 11:30:20AM -0400, Geoff Hutchison wrote:
>
> gil wrote:
> > Does anyone know why I get this error. The file contains about 12,000
> > URL's. Is that too many? Are the backticks necessary in the start_url
> > command?
>
> The backticks are necessary.
>
> Considering the out of memory message, 12,000 URLs is too many for you.
This is true!
for 65000+ URLs i needed 300+ MB of virtual memory!

> You can either get more RAM or swap space (or both) or cut down on the
> size of start_urls (for instance by having pages in the list link to
> each other).
>
> --
> -Geoff Hutchison
> Williams Students Online
> http://wso.williams.edu/
> ------------------------------------
> To unsubscribe from the htdig mailing list, send a message to
> htdig@htdig.org containing the single word "unsubscribe" in
> the SUBJECT of the message.
>

-- 

--------------------------------------------------- Marcin Owsiany porridge@lo4.ids.bielsko.pl --------------------------------------------------- ------------------------------------ To unsubscribe from the htdig mailing list, send a message to htdig@htdig.org containing the single word "unsubscribe" in the SUBJECT of the message.



This archive was generated by hypermail 2.0b3 on Fri Jul 09 1999 - 08:58:30 PDT