[htdig] Identifying non-indexed URLs

Subject: [htdig] Identifying non-indexed URLs
From: Bigler, Tyson MT SSI (MB729121@MSXSEPC.SHELL.COM)
Date: Tue Mar 14 2000 - 05:41:34 PST

Is it possible to log URLs which are not indexed? The -vv flag will show
level 1 & level 2 rejects due to explicit exceptions, but I'm interested in
knowing which URLs were seen but not indexed because they weren't
"parsable". Is this easily done?

Thanks for any insight!


Tyson Bigler
Shell Services International, Inc.
EP Gas & Power, BTC Site Operations
3737 Bellaire Blvd. Room 1051B, Houston, TX 77025

To unsubscribe from the htdig mailing list, send a message to
You will receive a message to confirm this.

This archive was generated by hypermail 2b28 : Tue Mar 14 2000 - 05:47:13 PST