Re: [htdig] can't index external urls


Subject: Re: [htdig] can't index external urls
From: Geoff Hutchison (ghutchis@wso.williams.edu)
Date: Fri Dec 08 2000 - 12:53:15 PST


On Fri, 8 Dec 2000, Deb Whitten wrote:

> I am using htdig-3.1.0b2-1 and can't seem to index external urls. I
> added one to the start_url field. htdig sees 2 servers, but for some
> reason my hostname gets prepended to the external url, so it doesn't
> work.

<snip>

> I've searched through the bug lists and could find lots of examples of
> people indexing external sites, but it just won't work for me. I am
> currently building version 3.1.5 to see if that works better. Meanwhile,
> is this a known bug or am I missing something?

What does your start_url look like? It's a list of full URLs, e.g.:

start_url: http://www.foo.com/ http://www.bar.com/ [...]

Yes, you should upgrade ASAP to 3.1.5, but this sounds like a mistake in
the config file.

--
-Geoff Hutchison
Williams Students Online
http://wso.williams.edu/

------------------------------------ To unsubscribe from the htdig mailing list, send a message to htdig-unsubscribe@htdig.org You will receive a message to confirm this. List archives: <http://www.htdig.org/mail/menu.html> FAQ: <http://www.htdig.org/FAQ.html>



This archive was generated by hypermail 2b28 : Fri Dec 08 2000 - 13:02:41 PST