[htdig] exclude_urls setting

Scott Golby (ar-htdig@ar.ar.com.au)
Fri, 16 Jul 1999 07:24:22 +1000

        What have people found is a good a exclude_urls setting ?

        I found one system here had a cgi type directory called chbin
which I needed to go and exclude. I'm sure there must be some others out
there with all these ASP, Cold Fusion type things.

        Is there a correct procedure for going "oh hell" stopping the
htdig, adding the exclude and re-running, I've seen some funny DB errors
being printed out. (I'm still working out what the check database
commands are). Cool program.

        'C' ya ...

A.R. Internet, Sydney, Australia. Voice 02-9809-5333 Fax 02-9809-9199
Internet - SLIP/PPP Accounts $24.95/$34.95 a Month or $2.50 per hour.
FULL Internet connection. (ftp, irc, telnet, www). No Setup Fee. 56k
Web Page http://www.ar.com.au Telnet to the BBS telnet://bbs.ar.com.au

To unsubscribe from the htdig mailing list, send a message to
htdig@htdig.org containing the single word "unsubscribe" in
the SUBJECT of the message.

This archive was generated by hypermail 2.0b3 on Thu Jul 15 1999 - 13:42:51 PDT