Re: [htdig] Segfault indexing a site with 3.2.0b2


Subject: Re: [htdig] Segfault indexing a site with 3.2.0b2
From: Pataki-Peter Sandor (sanyi@dsp.nextra.ro)
Date: Wed May 24 2000 - 12:57:25 PDT


"NEPOTE Charles (Neuilly Gestion)" wrote:

>
>
> Hello,
>
> Indexing the same numbers of near identical documents (our intranet
> (about 65 000 files ; 340 000 "Kbytes requested" said ht://Dig
> 3.2.0b2)), I found this results :
>
> ht://Dig 3.1.5 :
> -- db.words.db : 177 Mo
> -- indexing and merging time : about 6 hours
>
> ht://Dig 3.2.0b2 :
> -- db.words.db : 1 393 Mo !!
> -- indexing and merging time : about 14 hours
>
> [Note that to increase speed, I tested many times the
> worldlist_cache_size: tou found best number is 50000000 (= 50 000 000)
> for my machine ; it is very nice with htsearch]
>
> [I have a pentium Pro 200 with 128 Mo RAM].
>
> Because of the bug I submitted I need to use worldlist_compress:
> false.
> Is it the reason for such a growing of db.words.db ???
>
> Tell me if you want me to test some things.
>
> Charles NÚpote.



This archive was generated by hypermail 2b28 : Wed May 24 2000 - 00:44:00 PDT