Subject: [htdig3-dev] Failing to get any pages indexed . .
From: Sphboc@aol.com
Date: Fri Mar 10 2000 - 00:10:50 PST
I've been getting, from several different sites, messages of this type;
manual inspection of the site reveals that there are in fact pages present.
(and, there's no evidence of any robots.txt existing) . .
Does anyone have any insights?
New server: smarterkids.com, 80
0:0:0:http://smarterkids.com/: redirect
htdig: Run complete
htdig: 1 server seen:
htdig: smarterkids.com:80 1 document
------------------------------------
To unsubscribe from the htdig3-dev mailing list, send a message to
htdig3-dev-unsubscribe@htdig.org
You will receive a message to confirm this.
This archive was generated by hypermail 2b28 : Fri Mar 10 2000 - 00:16:28 PST