RE: [htdig] Commenting allowed in external star_url and limit_url

Subject: RE: [htdig] Commenting allowed in external star_url and limit_url
From: Stein, Thomas (AGLW) (
Date: Tue Jan 25 2000 - 05:28:05 PST

Geoff and Gilles,
thanks for your response. I tried various ways and finally deleted all
comments in the external input file ("start_url:..." substitute) and it
worked perfectly right ! Before it was 'wading off' into the world...
Allowing commenting, like suggested by Gilles being a simple addition in the
code, would be a great help to keep track with your long URL list of files
to be indexed.
Many thanks

        -----Original Message-----
        From: Gilles Detillieux []
        Sent: Wednesday, January 19, 2000 11:58 PM
        Cc: Stein, Thomas (AGLW);
        Subject: Re: [htdig] Commenting allowed in external star_url
and limit_url

        According to Geoff Hutchison:
> At 7:42 PM +0100 1/18/00, Stein, Thomas (AGLW) wrote:
> >As I am indexing multiple servers I would like to specify those
URLs in a
> >special starting_urls_file and limiting_urls_file. I wonder
> >commenting with # is allowed in those files. If yes, are spaces
between the
> ># and the comment are allowed as well?
> I believe so--I think it just does a recursive parse on the file
> before including it in the config. So all the normal features of a

> config file are used (including comments).
> Once the config parser sees a '#' character, it ignores the rest
of the line.

        This is true of the config file include mechanism, but I think
Thomas was
        referring to the attribute file substitution mechanism, e.g.:

          start_url: `${config_dir}/starting_urls_file`

        This is handled by ParsedString::getFileContents(), which does not
        allow comments. It would be a pretty simple addition to the code,

        Gilles R. Detillieux E-mail:
        Spinal Cord Research Centre WWW:
        Dept. Physiology, U. of Manitoba Phone: (204)789-3766
        Winnipeg, MB R3E 3J7 (Canada) Fax: (204)789-3930

To unsubscribe from the htdig mailing list, send a message to
You will receive a message to confirm this.

This archive was generated by hypermail 2b28 : Tue Jan 25 2000 - 05:27:49 PST