Re: [htdig] Using htdig on the WWW Virtual Library


Daniel Marek Gradzikiewicz (gdaniel@softhome.net)
Tue, 27 Apr 1999 08:16:02 -0400


how big is your database ? Did you use multidig and multiple databases ? What
is the average time that you need to 'dig' all these documents ?

"Budd, S." wrote:

> We have a site with 150 servers and over 380,000 documents indexed.
>
> I do not have any experience with multi-lingual indexing but I do know that
> French and German sites are using htdig.
>
> > -----Original Message-----
> > From: Gabriel Fenteany [SMTP:fenteany@calvin.bwh.harvard.edu]
> > Sent: 27 April 1999 03:51
> > To: htdig@htdig.org
> > Subject: [htdig] Using htdig on the WWW Virtual Library
> >
> >
> >
> > Hello. The WWW Virtual Library (http://vlib.org/) is a distributed
> > responsibility Web index of 288 separate sites linked to a central catalog
> > spanning a huge range of topics, academic and not. It was actually
> > started
> > by Tim Berners-Lee himself and was once partly served from the W3C. It's
> > been around since 1991 and has all sorts of different individual sites:
> > some static HTML, some - much fewer - databases such as Links2, etc. We
> > would like to implement a search engine that gets all of the HTML and text
> > files on all 288 sites, tens of thousands of documents. There is little
> > hope that in the near future the sites will be unified around one format,
> > and this may not be desirable for us anyway, since each site serves a core
> > of specialists with differing needs; however, we'd like to put in place at
> > least a broad, top-level search engine that gets the user to the right
> > page
> > of links in the right site.
> >
> > We'd like to know whether you think ht://Dig would be a good solution for
> > us.
> >
> > Any and all comments would be very much appreciated.
> >
> > Thanks!
> >
> > Gabriel
> >
> > --
> > Gabriel Fenteany, Ph.D.
> > Maintainer, WWW Virtual Library: Cell Biology
> > ------------------------------------
> > To unsubscribe from the htdig mailing list, send a message to
> > htdig@htdig.org containing the single word "unsubscribe" in
> > the SUBJECT of the message.
> ------------------------------------
> To unsubscribe from the htdig mailing list, send a message to
> htdig@htdig.org containing the single word "unsubscribe" in
> the SUBJECT of the message.

------------------------------------
To unsubscribe from the htdig mailing list, send a message to
htdig@htdig.org containing the single word "unsubscribe" in
the SUBJECT of the message.



This archive was generated by hypermail 2.0b3 on Tue Apr 27 1999 - 05:23:20 PDT