[htdig] HTDIG doesn't follow /cgi-bin/name.cgi?option=blafasel - Links

gstammw (gstammw@gmx.net)
Wed, 17 Mar 1999 15:27:07 +0100

• Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]
• Next message: Geoff Hutchison: "Re: [htdig] Indexing only HTML (again)"
• Previous message: Frank Richter: "Re: [htdig] Indexing only HTML (again)"
• Next in thread: Geoff Hutchison: "Re: [htdig] HTDIG doesn't follow /cgi-bin/name.cgi?option=blafasel"

Hello !

I'm running on www.edu-search.de .
My configuartion has disabled the cgi-bin/.cgi-deny-entry and the
maximum-hop setting has been set to 8 hops.
On my start-page (hop0) there are different links like <a
href="http://www.fundus.org>fundus</a>.
The problem is, that htdig doesn't follow links on the page www.fundus.org
which point to a cgi-script like this...
www.server.de/cgi-bin/scriptname.cgi?option=value.

What can I do ??

Another question: is there the possibility to disallow some hosts like
www.sex.com or something like that :-) I don't want all these
porno-shit-sites in my index.

Thank you,
Gunther Stammwitz
Administrator of edu-search.de
Reply to: GSTAMMW@GMX.NET

---
Da wohne ich:
http://terraserver.microsoft.com/GetTileByClick.asp?XId=9059&YId=13451&SrcId
=2&ImgDate=05/17/1992&ImgSize=0&DSize=0&W=192&H=131&ClickAt=?91,95
_-=* LINUX - it's true and it's alive *=-_
EDU-SEARCH (http://www.edu-search.de) Die Suchmaschine für Schule&Bildung
------------------------------------
To unsubscribe from the htdig mailing list, send a message to
htdig@htdig.org containing the single word "unsubscribe" in
the SUBJECT of the message.

• Next message: Geoff Hutchison: "Re: [htdig] Indexing only HTML (again)"
• Previous message: Frank Richter: "Re: [htdig] Indexing only HTML (again)"
• Next in thread: Geoff Hutchison: "Re: [htdig] HTDIG doesn't follow /cgi-bin/name.cgi?option=blafasel"

This archive was generated by hypermail 2.0b3 on Wed Mar 17 1999 - 10:05:13 PST