Re: [htdig] new ask

Subject: Re: [htdig] new ask
From: Torsten Neuer (
Date: Thu Sep 07 2000 - 09:45:46 PDT

Torsten Neuer wrote:
> Andoni Ayala wrote:
> >
> > Hello!
> >
> > In a directory that not have "DirectoryIndex" archives (normaly index.html index.htm)
> >
> > How can i do for not index the page automatica generated by apache.?
> >
> > i´m trying with
> > remove_default_doc: index.html index.htm
> > but not works
> 3) Hack Apache mod_autoindex to include a <!--htdig_noindex-->
> or issue a <META NAME="robots" CONTENT="noindex,follow"> in
> the header of the automatically generated index.

Just discovered that it could be done without hacking Apache ;-)

In the .htaccess file for the directory:
        HeaderName .htrobots
        IndexOptions FancyIndexing SuppressHTMLPreamble

In the file .htrobots:
<META NAME="robots" CONTENT="noindex,follow">
<TITLE>Index of /foo/bar</TITLE>


The SuppressHTMLPreamble (Apache 1.3 and later) suppresses automatic
of the HTML preamble for the automatically generated directory index.
The file
HeaderName is usually displayed right after the preamble is written. If
now the
preamble is suppressed, the HeaderName file must contain a proper HTML
This can also include a "robots" META tag which allows the indexer to
follow the
web tree through this directory and index the files in the directory but
omit the
directory index itself.



InWise - Wirtschaftlich-Wissenschaftlicher Internet Service GmbH
Waldhofstraße 14                            Tel: +49-4101-403605
D-25474 Ellerbek                            Fax: +49-4101-403606
E-Mail:            Internet:

------------------------------------ To unsubscribe from the htdig mailing list, send a message to You will receive a message to confirm this. List archives: <> FAQ: <>

This archive was generated by hypermail 2b28 : Thu Sep 07 2000 - 09:48:13 PDT