[htdig] Multiple servers in one database

Marcin Owsiany (porridge@lo4.ids.bielsko.pl)
Mon, 7 Jun 1999 15:17:34 +0200

I'm not sure if the previous message got there... i'll better post it once
again.. sorry


attached mail follows:

The situation is:
 * i have got a large list (several thousands) of servers to index (i know that
htdig is only for small intranets etc, but suppose i'm mad and i've got unlimited
amount of disk space)
 * i want to have a searchable (with htsearch) database of them all -
preferably in one file (i.e. i want to be able to search all of them with a
single form query)


the list is too long to include it in a single config file after start_url.
(or maybe it isn't - will htdig be able to read several-hundred-kilobytes-long line)?
so i have to make multiple config files and run htdigs serially.

the most important question is: do i have to make multiple databases and
then merge them

or (preferably)
make htdig append more and more information to the single file and then run
htmerge once?

looking forward to your reply


--------------------------------------------------- Marcin Owsiany porridge@lo4.ids.bielsko.pl ---------------------------------------------------

------------------------------------ To unsubscribe from the htdig mailing list, send a message to htdig@htdig.org containing the single word "unsubscribe" in the SUBJECT of the message.

This archive was generated by hypermail 2.0b3 on Mon Jun 07 1999 - 03:30:40 PDT