Checking of external Links with htdig?


Reiner Keller (dlrg@cs.tu-berlin.de)
Thu, 19 Nov 1998 19:55:13 +0100 (MET)


Hello,

1) Sometimes htdig reports such error without Ref:

   "Not found: http://www.xxx.de/xxx/xxx Ref: "

   Why? Were there several referer pages with this URL?

2) I think when HtDig get's an URL it first checks if this URL is in the
   list $limit_urls_to.

   It would be a nice option that htdig check if this URL exists with a
   HEAD- Request, if the URL isn't in this list. It this possible? Thanks.

Reiner

-- 
------------------------------------------------------------------------
Reiner Keller                   e-mail: DLRG@cs.TU-Berlin.de
                                WWW   : http://www.cs.TU-Berlin.de/~dlrg
------------------------------------------------------------------------



This archive was generated by hypermail 2.0b3 on Sat Jan 02 1999 - 16:28:50 PST