Subject: [htdig] The 4:02 crash
From: Vincent QUERU (email@example.com)
Date: Tue Sep 12 2000 - 08:39:00 PDT
I recently had trouble running htdig with cron but thanks to the "rundig.sh"
script you provided everything is
now fine but I noticed that every morning when I arrive at the office the search
engine had crashed.
But looking through Apache's access log I noticed the following 2 lines :
my_server - - [12/Sep/2000:04:02:00 +0200] "GET /robots.txt HTTP/1.0" 404 278
my_server - - [12/Sep/2000:04:02:00 +0200] "GET
/r2_admin/robot_init_page/?ht_dig_robot=1 HTTP/1.0" 401
I did not do a "robots.txt" file as my server is the only one to index the site.
It looks as if there is some kind of automatic indexing (of course 4:02 is
nowhere to be found in my crontab)
but I did not find anything in the documentation about it and the problem is
that after it my db.wordlist file is
What can I do to stop this ?
Thanks a lot !
To unsubscribe from the htdig mailing list, send a message to
You will receive a message to confirm this.
List archives: <http://www.htdig.org/mail/menu.html>
This archive was generated by hypermail 2b28 : Tue Sep 12 2000 - 08:41:04 PDT