Re: [htdig3-dev] indexing entire site


Geoff Hutchison (ghutchis@wso.williams.edu)
Sun, 3 Oct 1999 13:22:23 -0500


At 10:47 AM +0530 10/2/99, B.G. Mahesh wrote:
>I don't have any robots.txt on http://food.indiainfo.com
>But I do have one on http://www.indiainfo.com which reads

Here's your problem, as seen in your output:

New server: food.indainfo.com, 80
Unknown host: food.indainfo.com

So the machine doing the indexing cannot find the DNS for food.indiainfo.com.

-Geoff Hutchison
Williams Students Online
http://wso.williams.edu/

------------------------------------
To unsubscribe from the htdig3-dev mailing list, send a message to
htdig3-dev@htdig.org containing the single word "unsubscribe" in
the SUBJECT of the message.



This archive was generated by hypermail 2.0b3 on Sun Oct 03 1999 - 11:28:27 PDT