Re: [htdig] db sizes with 3.1.5


Subject: Re: [htdig] db sizes with 3.1.5
From: Malcolm Austen (malcolm.austen@computing-services.oxford.ac.uk)
Date: Wed Mar 01 2000 - 02:17:40 PST


On Mon, 28 Feb 2000, Gilles Detillieux wrote:

+ According to Rusty Wright:
+ > With 3.1.5 I noticed the files in the db directory are about 3 times
+ > bigger than with 3.1.2; is this normal? I couldn't find any mention
+ > of this in the release notes on the web site.
<snip>
+ should not be added to the database, please let us know. However,
+ without anything more than database sizes to go on, it's pretty hard to
+ determine if the size increase is unusual or not.

Just to confirm Giles thoughts, I ran 3.1.5 "for real" last night and on
1.5Gb of files saw no significant (given that the dataset being indexed
will have changed) change in filesizes over those from 3.1.4 a week ago:

[spider@daneel wwwsearch]$ ls -l current/
total 1515173
-rw-rw-r-- 1 spider spider 308214784 Mar 1 04:49 db.docdb
-rw-rw-r-- 1 spider spider 239988862 Mar 1 03:57 db.docs
-rw-rw-r-- 1 spider spider 9594880 Mar 1 04:49 db.docs.index
-rw-rw-r-- 1 spider spider 22269952 Mar 1 05:02 db.metaphone.db
-rw-rw-r-- 1 spider spider 16799744 Mar 1 05:01 db.soundex.db
-rw-rw-r-- 1 spider spider 526316276 Mar 1 04:27 db.wordlist
-rw-rw-r-- 1 spider spider 422280192 Mar 1 04:27 db.words.db
[spider@daneel wwwsearch]$ ls -l old
total 1515217
-rw-rw-r-- 1 spider spider 309071872 Feb 23 05:07 db.docdb
-rw-rw-r-- 1 spider spider 240409416 Feb 23 04:19 db.docs
-rw-rw-r-- 1 spider spider 9714688 Feb 23 05:07 db.docs.index
-rw-rw-r-- 1 spider spider 22256640 Feb 23 05:18 db.metaphone.db
-rw-rw-r-- 1 spider spider 16756736 Feb 23 05:18 db.soundex.db
-rw-rw-r-- 1 spider spider 525462496 Feb 23 04:47 db.wordlist
-rw-rw-r-- 1 spider spider 421837824 Feb 23 04:47 db.words.db

regards,
        Malcolm.

 Malcolm.Austen@OUCS.ox.ac.uk http://users.ox.ac.uk/~malcolm/

------------------------------------
To unsubscribe from the htdig mailing list, send a message to
htdig-unsubscribe@htdig.org
You will receive a message to confirm this.



This archive was generated by hypermail 2b28 : Wed Mar 01 2000 - 02:22:08 PST