Re: htdig: can't index more then 830 files in the same directory


Ofer Dagan (odagan@hotmail.com)
Wed, 09 Sep 1998 20:22:33 PDT


Yes, you were right.
Thanks Mike.

>From andrew@contigo.com Fri Sep 4 10:35:36 1998
>Received: from contigo.com (turtle@shield.contigo.com [209.75.193.4])
> by rodan.contigo.com (8.8.8/8.8.8/Debian/GNU) with ESMTP id KAA04916;
> Fri, 4 Sep 1998 10:35:32 -0700
>Sender: turtle@contigo.com
>Message-ID: <35F024E4.29468A52@contigo.com>
>Date: Fri, 04 Sep 1998 10:35:32 -0700
>From: Andrew Scherpbier <andrew@contigo.com>
>Organization: Contigo Software
>X-Mailer: Mozilla 4.06 [en] (X11; I; Linux 2.0.34 i686)
>MIME-Version: 1.0
>To: Mike Dagan <odagan@hotmail.com>
>CC: htdig@sdsu.edu
>Subject: Re: htdig: can't index more then 830 files in the same
directory
>References: <19980904155215.11376.qmail@hotmail.com>
>Content-Type: text/plain; charset=us-ascii
>Content-Transfer-Encoding: 7bit
>
>Mike Dagan wrote:
>>
>> Hi,
>>
>> i am running htdig on a linux machine p200/32 Meg machine.
>> It seems that htdig can not index more then 830 documents in one
>> directory. I had one directory that had more then 8000 html pages.
>> When i run htdig it just inexes the first 830 documents.
>>
>> I had to divid the files into many directories to make it work.
>>
>> Does anyone have any idea what is the problem?
>> how can i index more then 830 doc in the same directory?
>>
>> Thanks,
>> Mike
>
>It probably has to do with the default document size limit that htdig
uses.
>Modify the max_doc_size attribute to something big enough so that the
whole
>index page will be read in.
>By default this attribute is set to 100000 (~100KB) so your index is
probably
>larger than that.
>
>--
>Andrew Scherpbier <andrew@contigo.com>
>Contigo Software <http://www.contigo.com/>
>

______________________________________________________
Get Your Private, Free Email at http://www.hotmail.com



This archive was generated by hypermail 2.0b3 on Sat Jan 02 1999 - 16:27:46 PST