Re: [htdig] Normal?

Geoff Hutchison (
Sun, 27 Jun 1999 16:46:11 -0400 (EDT)

On Fri, 25 Jun 1999, Jim Cole wrote:

> However, the entire site I am trying to index is only about 178 MB,
> including all of the graphics files. Does it make sense that my current
> databases should be 3 times the size of the entire site and still
> growing?

That depends. Do you have many links to pages so that a given page may
have several unique URLs? If so, you're probably indexing these pages many
times. If you have dynamic content, it's possible to lose any indexer in
an infinite loop if you're not careful.

-Geoff Hutchison
Williams Students Online

To unsubscribe from the htdig mailing list, send a message to containing the single word "unsubscribe" in
the SUBJECT of the message.

This archive was generated by hypermail 2.0b3 on Sun Jun 27 1999 - 13:07:58 PDT