Subject: Re: [htdig] Suggetions on Speeding up Search
From: Geoff Hutchison (firstname.lastname@example.org)
Date: Mon Jul 31 2000 - 11:38:15 PDT
At 12:00 PM -0500 7/31/00, Chad Phillips wrote:
>I installed another version of htdig and set it to dig about 30
>sites. Everything went ok, but when I run a search it is extremely
How does the server respond? Does it seem like it's starting to page?
Have you tried running htsearch from the command-line? If so, does it
seem like the slowdown is from htsearch itself or from some sort of
>The db for the second htdig, is about twice as big as the db for the
>first htdig. But the search takes about 5-10 longer. I set the
Remember that it's not going to scale linearly with the disk space of
the database. That's an important factor since many searches are
bounded by the number of disk accesses. But the searches are more
closely bound to the number of word matches. So if you're doing
searches for very common words, it's bound to take longer since more
matches must be scored.
You said you're running this on a Sun box, so I can't say you should
switch to a faster disk. :-) But how much RAM does it have?
-- -Geoff Hutchison Williams Students Online http://wso.williams.edu/
------------------------------------ To unsubscribe from the htdig mailing list, send a message to email@example.com You will receive a message to confirm this.
This archive was generated by hypermail 2b28 : Mon Jul 31 2000 - 01:37:45 PDT