[htdig] htdig indexes more than one server

Anne Sauvage (ad@gamsau.map.archi.fr)
Fri, 09 Jul 1999 14:08:11 +0200

Htdig is installed on a SUN Solaris 2.6. The seb server
www.gamsau.archi.fr with apache is installed on it.

Here is the beginning of my htdig.conf file :
database_dir: /export/home0/apache/archi/htdocs/SAARA/htdig/db

start_url: http://calder.gamsau.archi.fr/
limit_urls_to: ${start_url}

I run htdig with : /usr/local/bin/htdig -c /usr/local/conf/htdig.conf

Why www.gamsau.archi.fr is also indexed even if I didn't ask for it?

New server: calder.gamsau.archi.fr, 80
Retrieval command for http://calder.gamsau.archi.fr/robots.txt: GET
User-Agent: htdig/3.1.2 (ad@gamsau.map.archi.fr)
Host: calder.gamsau.archi.fr

Header line: HTTP/1.0 404 Objet non trouvé
Header line: Content-Type: text/html
Header line:
returnStatus = 1

New server: www.gamsau.archi.fr, 80
Retrieval command for http://www.gamsau.archi.fr/robots.txt: GET
/robots.txt HTTP/1.0
User-Agent: htdig/3.1.2 (ad@gamsau.map.archi.fr)
Host: www.gamsau.archi.fr

Thanks for your help

This archive was generated by hypermail 2.0b3 on Fri Jul 09 1999 - 04:18:00 PDT