Subject: RE: [htdig] Segfault indexing a site with 3.2.0b2
From: NEPOTE Charles (Neuilly Gestion) (firstname.lastname@example.org)
Date: Wed May 24 2000 - 02:41:40 PDT
Indexing the same numbers of near identical documents (our intranet (about
65 000 files ; 340 000 "Kbytes requested" said ht://Dig 3.2.0b2)), I found
this results :
ht://Dig 3.1.5 :
-- db.words.db : 177 Mo
-- indexing and merging time : about 6 hours
ht://Dig 3.2.0b2 :
-- db.words.db : 1 393 Mo !!
-- indexing and merging time : about 14 hours
[Note that to increase speed, I tested many times the worldlist_cache_size:
tou found best number is 50000000 (= 50 000 000) for my machine ; it is very
nice with htsearch]
[I have a pentium Pro 200 with 128 Mo RAM].
Because of the bug I submitted I need to use worldlist_compress: false.
Is it the reason for such a growing of db.words.db ???
Tell me if you want me to test some things.
This archive was generated by hypermail 2b28 : Wed May 24 2000 - 00:31:09 PDT