Re: [htdig] how to search sub directories

Torsten Neuer (
Fri, 9 Jul 1999 09:18:58 +0200

According to gil:
>Is there no way of configuring htdig to look in a subdirectory such as
>/usr/members that contains all the members' web sites that we manage?
>>From what I understand from the message below, I need to create an
>index.html page that contains all of the urls for every member. There
>are tens of thousands of members. We can write a short perl script to automate
>the creation of a large index page listing all of the members pages, but
>before doing so I want to make sure we're not overlooking an a more
>straight forward approach.

Sure this is possible since everywhere in the configuration file you are
able to include files (not only with the include directive but also by
"inlining" them).

Just create such a file for the start_url directive from the content
of your userspace directories (by "ls -1 /your/memberdir" and some
sed/awk reformatting) before calling the digger.


InWise - Wirtschaftlich-Wissenschaftlicher Internet Service GmbH
Waldhofstraße 14                            Tel: +49-4101-403605
D-25474 Ellerbek                            Fax: +49-4101-403606
E-Mail:            Internet:

------------------------------------ To unsubscribe from the htdig mailing list, send a message to containing the single word "unsubscribe" in the SUBJECT of the message.

This archive was generated by hypermail 2.0b3 on Thu Jul 08 1999 - 23:50:13 PDT