Re: [htdig] Using a different program for digging

Subject: Re: [htdig] Using a different program for digging
From: Torsten Neuer (
Date: Thu Sep 07 2000 - 01:02:12 PDT

Luis Henrique Cassis Fagundes wrote:
> Hi,
> I need a search engine for a heavy loaded website with a lot of
> information, and I'd like to use htdig. The problem is that the texts to
> be indexed are not in a page, they're in an Oracle database, so htdig
> can't index them. I want to make a program (that I believe it will be
> much simpler than htdig itself) to read the database and generate
> db.docdb and db.wordlist, so htmerge would create the word database as
> it were from the website, as I want.

One simple question: How do your website get to the contents of the
database? Ht://Dig can index everything your site provides with proper
references to the corresponding URLs. This cannot be achieved by
accessing the SQL database with any spider.

So since you definitely want to index a website rather than an SQL
database and use the index to retrieve web pages, I cannot really
see where your problem is ;)


InWise - Wirtschaftlich-Wissenschaftlicher Internet Service GmbH
Waldhofstraße 14                            Tel: +49-4101-403605
D-25474 Ellerbek                            Fax: +49-4101-403606
E-Mail:            Internet:

------------------------------------ To unsubscribe from the htdig mailing list, send a message to You will receive a message to confirm this. List archives: <> FAQ: <>

This archive was generated by hypermail 2b28 : Thu Sep 07 2000 - 01:04:50 PDT