Re: htdig: Re: your mail


Rodger Zeisler (rzeisler@eversoft.com)
Thu, 31 Dec 1998 13:01:12 -0600


----- Original Message -----
From: Geoff Hutchison <ghutchis@wso.williams.edu>
To: htDig user <htdig@as.westblaak.spirit.nl>
Cc: <htdig@sdsu.edu>
Sent: Thursday, December 31, 1998 9:14 AM
Subject: htdig: Re: your mail

>
>On Thu, 31 Dec 1998, htDig user wrote:
>
>> I want to index all pages per host, by using a single config file.
>> Therefore I set max_hops_count to about 10, but that also indexes (way
>> too much) sites from 'the outside'.
>> Is there a possiblity to look for IP's when digging?
>...
>> So, instead of setting limit_urls to a stringpattern, I suggest that also
>> IP-numbers are going to be allowed? Something like 127.0.0 (leaving the
>> last part...!)
>
>This might also index other sites... What are you using as your
>limit_urls? I would assume using the virtual hostnames in your limit_urls
>would work nicely for you. You could even put them in an external file and
>include the file if you don't want 100 URLs in your config file.

What is the syntax for including the URLs in an external file?

>
>-Geoff Hutchison
>Williams Students Online
>http://wso.williams.edu/
>
>----------------------------------------------------------------------
>To unsubscribe from the htdig mailing list, send a message to
>htdig-request@sdsu.edu containing the single word "unsubscribe" in
>the body of the message.
>

----------------------------------------------------------------------
To unsubscribe from the htdig mailing list, send a message to
htdig-request@sdsu.edu containing the single word "unsubscribe" in
the body of the message.



This archive was generated by hypermail 2.0b3 on Sat Jan 02 1999 - 16:29:57 PST