Re: [htdig] htdig crashing TOP and other telnet sessions?

Geoff Hutchison (
Wed, 27 Oct 1999 23:29:34 -0500

>Im trying to install HTDig to database a website which requires a
>login/password first, then it takes you to a disclaimer which uses a
>cgi script to finally move you on to the website.
> <--- asks for password
> <--- disclaimer with cgi "I agree" Button.
> <--- web sites front page.

I have no idea about the other behavior you see. While ht://Dig will
gladly authenticate the password if you supply it one, there's no way
for it (or any other search engine) to know to "click" the "I agree"

In general, search engines ignore forms. This goes for the one you
describe, as well as the increasingly common "redirect" form used for

In other words, if you want to index your site, I'd start on "default.htm"

-Geoff Hutchison
Williams Students Online

To unsubscribe from the htdig mailing list, send a message to containing the single word unsubscribe in
the SUBJECT of the message.

This archive was generated by hypermail 2.0b3 on Wed Oct 27 1999 - 21:53:41 PDT