Re: htdig: htmerge using 4GB


Esa Ahola (esa@mindspring.com)
Wed, 27 May 1998 12:20:15 -0400 (EDT)


On Wed, 27 May 1998, Geoff Hutchison wrote:

> > There's nothing to change. GNU sort is fairly good. It will be a hell
> > of a job to rewrite sort...
>
> See that's just it, I'm not looking for a "better" sort, just one which
> doesn't use so many files. I would imagine one using bubblesort of
> something like that would work well. It would take longer to merge but
> would require 2-3 times the space of the DB for merging, not the 30-40
> I'm seeing now.

Two observations:

1. GNU sort does *not* require 30-40 times the size of the file.
   I'm using sort from textutils-1.14 to sort a 300+ megabyte
   word list with the usual and customary amount of temp space
   consumption. Something else must be going on with your disk
   starvation.

2. Jesse's recent patch for Btree support theoretically eliminates the
   requirement for a sort and merge phase entirely (right, Andrew?)

-- 
Esa Ahola
esa@mindspring.com

---------------------------------------------------------------------- To unsubscribe from the htdig mailing list, send a message to htdig-request@sdsu.edu containing the single word "unsubscribe" in the body of the message.



This archive was generated by hypermail 2.0b3 on Sat Jan 02 1999 - 16:26:18 PST