RE: [htdig] Segfault indexing a site with 3.2.0b2


Subject: RE: [htdig] Segfault indexing a site with 3.2.0b2
From: NEPOTE Charles (Neuilly Gestion) (charles.nepote@cetelem.fr)
Date: Wed May 24 2000 - 02:41:40 PDT


Hello,

Indexing the same numbers of near identical documents (our intranet (about
65 000 files ; 340 000 "Kbytes requested" said ht://Dig 3.2.0b2)), I found
this results :

ht://Dig 3.1.5 :
 -- db.words.db : 177 Mo
 -- indexing and merging time : about 6 hours

ht://Dig 3.2.0b2 :
 -- db.words.db : 1 393 Mo !!
 -- indexing and merging time : about 14 hours

[Note that to increase speed, I tested many times the worldlist_cache_size:
tou found best number is 50000000 (= 50 000 000) for my machine ; it is very
nice with htsearch]
[I have a pentium Pro 200 with 128 Mo RAM].

Because of the bug I submitted I need to use worldlist_compress: false.
Is it the reason for such a growing of db.words.db ???

Tell me if you want me to test some things.

Charles NÚpote.



This archive was generated by hypermail 2b28 : Wed May 24 2000 - 00:31:09 PDT