htdig: won't index a group of pages


Jed Michnowicz (jmichno@homer.providence.edu)
Sun, 07 Jun 1998 23:58:44 -0400


I have a script called "home.cgi" with a bunch of links in the document
like the following:

        "home.cgi?name=status"
        "home.cgi?name=contacts"
        etc...

Htdig will index the page "home.cgi", but it will not index the links in
the page that have the "home.cgi?name=somthing".

In the config file, I have limit_urls_to setup as:
        servername\cgi-bin\majordomo

The document resides at:
        servername\cgi-bin\majordomo\home.cgi
so this should not be the problem.

When I run htdig -vv I get the following output:

        url rejected: (level 1)http://servername/cgi-bin/majordomo/home.cgi
        A tag: pos = 2, position = =/cgi-bin/majordomo/home.cgi?name=status>
        A tag: pos = 0, position = =status>

I have other scripts some-what like this that do get indexed properly, but
their URL format is a little different:

        home.cgi?name=something?variable=otherthing

Does htdig think that it is a seperate document if the URL has 2 question
marks, but the same document if it has only 1 question mark.

TIA,
Jed

Jed Michnowicz '99
Student Technology Consultant
http://homer.providence.edu
----------------------------------------------------------------------
To unsubscribe from the htdig mailing list, send a message to
htdig-request@sdsu.edu containing the single word "unsubscribe" in
the body of the message.



This archive was generated by hypermail 2.0b3 on Sat Jan 02 1999 - 16:26:31 PST