Re: [htdig] Segfault indexing a site with 3.2.0b2


Subject: Re: [htdig] Segfault indexing a site with 3.2.0b2
From: Pataki-Peter Sandor (sanyi@dsp.nextra.ro)
Date: Wed May 24 2000 - 13:37:11 PDT


Pataki-Peter Sandor wrote:

>
>
> Pataki-Peter Sandor wrote:
>
>>
>>
>> "NEPOTE Charles (Neuilly Gestion)" wrote:
>>
>> >
>> >
>> > Hello,
>> >
>> > Indexing the same numbers of near identical documents (our intranet
>> > (about 65 000 files ; 340 000 "Kbytes requested" said ht://Dig
>> > 3.2.0b2)), I found this results :
>> >
>> > ht://Dig 3.1.5 :
>> > -- db.words.db : 177 Mo
>> > -- indexing and merging time : about 6 hours
>> >
>> > ht://Dig 3.2.0b2 :
>> > -- db.words.db : 1 393 Mo !!
>> > -- indexing and merging time : about 14 hours
>> >
>> > [Note that to increase speed, I tested many times the
>> > worldlist_cache_size: tou found best number is 50000000 (= 50 000
>> > 000) for my machine ; it is very nice with htsearch]
>> >
>> > [I have a pentium Pro 200 with 128 Mo RAM].
>> >
>> > Because of the bug I submitted I need to use worldlist_compress:
>> > false.
>> > Is it the reason for such a growing of db.words.db ???
>> >
>> > Tell me if you want me to test some things.
>> >
>> > Charles NÚpote.
>>



This archive was generated by hypermail 2b28 : Wed May 24 2000 - 01:23:53 PDT