Re: [htdig] Segfault indexing a site with 3.2.0b2


Subject: Re: [htdig] Segfault indexing a site with 3.2.0b2
From: Pataki-Peter Sandor (sanyi@dsp.nextra.ro)
Date: Wed May 24 2000 - 13:22:08 PDT


Pataki-Peter Sandor wrote:

>
>
> "NEPOTE Charles (Neuilly Gestion)" wrote:
>
>>
>>
>> Hello,
>>
>> Indexing the same numbers of near identical documents (our intranet
>> (about 65 000 files ; 340 000 "Kbytes requested" said ht://Dig
>> 3.2.0b2)), I found this results :
>>
>> ht://Dig 3.1.5 :
>> -- db.words.db : 177 Mo
>> -- indexing and merging time : about 6 hours
>>
>> ht://Dig 3.2.0b2 :
>> -- db.words.db : 1 393 Mo !!
>> -- indexing and merging time : about 14 hours
>>
>> [Note that to increase speed, I tested many times the
>> worldlist_cache_size: tou found best number is 50000000 (= 50 000
>> 000) for my machine ; it is very nice with htsearch]
>>
>> [I have a pentium Pro 200 with 128 Mo RAM].
>>
>> Because of the bug I submitted I need to use worldlist_compress:
>> false.
>> Is it the reason for such a growing of db.words.db ???
>>
>> Tell me if you want me to test some things.
>>
>> Charles NÚpote.
>



This archive was generated by hypermail 2b28 : Wed May 24 2000 - 01:08:40 PDT