[htdig] remove_bad_urls


Maria Cervantes (mariac@seciu.edu.uy)
Mon, 25 Oct 1999 13:59:45 -0200 (EDT)


Hi, I'm using htdig-3.1.2 and I have to index 66 servers, but sometimes
some of them can't be reached because they are down, etc. So I never get
the whole list of servers indexed.
However, I wish to keep in the database of the htdig, the documents of
the servers that coudn't be reach, but were indexed in a other time.
I put in the config file remove_bad_urls: false
I run htdig three days ago and I got:
                                htdig: Run complete
                                htdig: 66 servers seen:
                                htdig: iibce.edu.uy:80 162 documents
 
I run htdig yesterday and I got:
                                htdig: Run complete
                                htdig: 65 servers seen:
                                htdig: iibce.edu.uy:80 0 documents

I searched for words I know are in this url and I didn't get any
result.
Do you have any idea??
Did I misunderstand the usage of remove_bad_urls??

Thanks in advanced
                        Maria
-----------------------------------------------------------------------------
 Maria Cervantes
 E-Mail : mariac@seciu.edu.uy
 Servicio Central de Informatica - RAU
 Universidad de la Republica
 Colonia 2066 - Montevideo - Uruguay
 Tel : (598)(2) 4083901.
-----------------------------------------------------------------------------

------------------------------------
To unsubscribe from the htdig mailing list, send a message to
htdig@htdig.org containing the single word unsubscribe in
the SUBJECT of the message.



This archive was generated by hypermail 2.0b3 on Mon Oct 25 1999 - 12:46:36 PDT