Re: [htdig] subsequent digs


Geoff Hutchison (ghutchis@wso.williams.edu)
Tue, 27 Apr 1999 22:46:40 -0400


At 10:29 PM -0400 4/27/99, Tim Perdue, Geocrawler.com wrote:
>Is it safe to assume that merging with -m will eliminate duplicate URLs?
>
>I just want to make sure before I blow something up. 8-)

Yes. It checks the date stamps on duplicates and picks the most recent. I
was *very* careful when doing this section of the code, for obvious reasons.

-Geoff Hutchison
Williams Students Online
http://wso.williams.edu/

------------------------------------
To unsubscribe from the htdig mailing list, send a message to
htdig@htdig.org containing the single word "unsubscribe" in
the SUBJECT of the message.



This archive was generated by hypermail 2.0b3 on Tue Apr 27 1999 - 20:04:00 PDT