Re: [htdig] Indexing scope


Subject: Re: [htdig] Indexing scope
From: Dave Lers (dave@dalrun.com)
Date: Wed Apr 26 2000 - 11:16:06 PDT


On Sun, 16 Apr 2000, Geoff Hutchison wrote:
> At 11:14 AM -0700 4/16/00, Dave Lers wrote:

> >I just realized most/all my external URL's are in a flatfile db, can I do
> >something like:
> >
> >limit_urls_to: ${start_url} `/path/to/my.db`
> >(assuming they are all links to specific pages, no http://foo/ URL's)?.
>
> Oh sure. As long as there's whitespace between each URL, that'll work
> just fine.

Darn. Finally tried it and it seems to open the door to external URL's.
Its indexing and chasing all external links it finds in start_url pages (not
sure what its doing with pages listed in my.db).

------------------------------------
To unsubscribe from the htdig mailing list, send a message to
htdig-unsubscribe@htdig.org
You will receive a message to confirm this.



This archive was generated by hypermail 2b28 : Wed Apr 26 2000 - 12:17:31 PDT