Re: htdig: non-destructive updates


Michael Graff (explorer@flame.org)
16 Jun 1998 23:13:39 -0700


webmaster@www.nisu.flinders.edu.au writes:

> On 16 Jun, Michael Graff wrote:
> > Is there any reasonable way to do this?
> >
> > (1) index a group of sites.
> > (2) nightly, re-index them, updating the current database as
> > needed.
> > (3) keep searches up and running while the indexing is taking
> > place.
> > (4) not keep 2 copies of the database. It is already large.
> >
> > --Michael
>
> Short answer: the -a argument to htdig

This breaks (2) though -- it doesn't update the database, it totally
refetches every page. I'm going to be indexing well over 50,000
pages. Closer to 75,000 I suspect.

Yes, I could keep the old files around, but that seems like such a waste.

--Michael
----------------------------------------------------------------------
To unsubscribe from the htdig mailing list, send a message to
htdig-request@sdsu.edu containing the single word "unsubscribe" in
the body of the message.



This archive was generated by hypermail 2.0b3 on Sat Jan 02 1999 - 16:26:34 PST