htdig: Re: your mail


Geoff Hutchison (ghutchis@wso.williams.edu)
Thu, 31 Dec 1998 10:14:55 -0500 (EST)


On Thu, 31 Dec 1998, htDig user wrote:

> I want to index all pages per host, by using a single config file.
> Therefore I set max_hops_count to about 10, but that also indexes (way
> too much) sites from 'the outside'.
> Is there a possiblity to look for IP's when digging?
...
> So, instead of setting limit_urls to a stringpattern, I suggest that also
> IP-numbers are going to be allowed? Something like 127.0.0 (leaving the
> last part...!)

This might also index other sites... What are you using as your
limit_urls? I would assume using the virtual hostnames in your limit_urls
would work nicely for you. You could even put them in an external file and
include the file if you don't want 100 URLs in your config file.

-Geoff Hutchison
Williams Students Online
http://wso.williams.edu/

----------------------------------------------------------------------
To unsubscribe from the htdig mailing list, send a message to
htdig-request@sdsu.edu containing the single word "unsubscribe" in
the body of the message.



This archive was generated by hypermail 2.0b3 on Sat Jan 02 1999 - 16:29:57 PST