Re: [htdig] htdig indexes more than one server

Geoff Hutchison (ghutchis@wso.williams.edu)
Fri, 09 Jul 1999 08:22:57 -0400

• Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]
• Next message: Heid Joern: "[htdig] Problem with PDF-Parser"
• Previous message: Geoff Hutchison: "Re: [htdig] Stupid question...."
• In reply to: Heid Joern: "[htdig] Stupid question...."

"Anne Durand (Anne Sauvage)" wrote:
> Why www.gamsau.archi.fr is also indexed even if I didn't ask for it?

I would guess that the first URL is a redirect to www.gamsau.archi.fr,
so it follows it only to realize it's outside the bounds of the
limit_urls.

> 0:0:http://calder.gamsau.archi.fr/
..
> 0:0:http://calder.gamsau.archi.fr/scripts/statistiques/ax-admin202.pl?http://calder.gamsau.archi.fr/

You've obviously picked up a redirect to get to here.
calder.gamsau.archi.fr -> scripts/statistiques...
So what does that script do? From the htdig output, it looks like
another redirect.

-- 
-Geoff Hutchison
Williams Students Online
http://wso.williams.edu/
------------------------------------
To unsubscribe from the htdig mailing list, send a message to
htdig@htdig.org containing the single word "unsubscribe" in
the SUBJECT of the message.

• Next message: Heid Joern: "[htdig] Problem with PDF-Parser"
• Previous message: Geoff Hutchison: "Re: [htdig] Stupid question...."
• In reply to: Heid Joern: "[htdig] Stupid question...."

This archive was generated by hypermail 2.0b3 on Fri Jul 09 1999 - 04:39:57 PDT