[htdig] The 4:02 crash


Subject: [htdig] The 4:02 crash
From: Vincent QUERU (vqueru@free.fr)
Date: Tue Sep 12 2000 - 08:39:00 PDT


Hi !

I recently had trouble running htdig with cron but thanks to the "rundig.sh"
script you provided everything is
now fine but I noticed that every morning when I arrive at the office the search
engine had crashed.

But looking through Apache's access log I noticed the following 2 lines :

my_server - - [12/Sep/2000:04:02:00 +0200] "GET /robots.txt HTTP/1.0" 404 278
my_server - - [12/Sep/2000:04:02:00 +0200] "GET
/r2_admin/robot_init_page/?ht_dig_robot=1 HTTP/1.0" 401
471

I did not do a "robots.txt" file as my server is the only one to index the site.

It looks as if there is some kind of automatic indexing (of course 4:02 is
nowhere to be found in my crontab)
but I did not find anything in the documentation about it and the problem is
that after it my db.wordlist file is
empty...

What can I do to stop this ?

Thanks a lot !

------------------------------------
To unsubscribe from the htdig mailing list, send a message to
htdig-unsubscribe@htdig.org
You will receive a message to confirm this.
List archives: <http://www.htdig.org/mail/menu.html>
FAQ: <http://www.htdig.org/FAQ.html>



This archive was generated by hypermail 2b28 : Tue Sep 12 2000 - 08:41:04 PDT