Subject: RE: [htdig] problem indexing a site
From: Geoff Hutchison (ghutchis@wso.williams.edu)
Date: Wed Jan 17 2001 - 08:42:00 PST
If you aren't using port 80, you will need to set this in the start_url,
e.g.:
start_url: http://www.foo.com:81/
Cheers,
-- -Geoff Hutchison Williams Students Online http://wso.williams.edu/On Wed, 17 Jan 2001, Elsa Chan wrote:
> It just hangs for 10 to 15 minutes. > > If port 80 is not what we use, do I go and change this in the robots.txt > file? > > Where is this file? > > Thanks
------------------------------------ To unsubscribe from the htdig mailing list, send a message to htdig-unsubscribe@htdig.org You will receive a message to confirm this. List archives: <http://www.htdig.org/mail/menu.html> FAQ: <http://www.htdig.org/FAQ.html>
This archive was generated by hypermail 2b28 : Wed Jan 17 2001 - 08:56:42 PST