Re: [htdig] Using htdig as link checker

Subject: Re: [htdig] Using htdig as link checker
From: Torsten Neuer (
Date: Mon Nov 22 1999 - 00:30:26 PST

> David Wall wrote:
> Has anybody looked into using htdig as a site-wide link-checker? I
> can see that it will find bad links within my site, but is there a way
> to extend it to check the first link that goes outside the site? I
> wouldn't want it to index that outside page, but check to see if it's
> reachable.

A possible solution to your problem would be to use a program called
"deadlinkcheck" (should be accessible via freshmeat). It takes a list
of URLs (can be generated by Ht://Dig, but should be piped through
sort|uniq first) and outputs a file with server responses. Quite
useful (you have to check redirects by hand though).


InWise - Wirtschaftlich-Wissenschaftlicher Internet Service GmbH
Waldhofstraße 14                            Tel: +49-4101-403605
D-25474 Ellerbek                            Fax: +49-4101-403606
E-Mail:            Internet:

------------------------------------ To unsubscribe from the htdig mailing list, send a message to You'll receive a message confirming the unsubscription.

This archive was generated by hypermail 2b25 : Mon Nov 22 1999 - 00:43:03 PST