Re: [htdig] Indexing only HTML (again)


Benson Yeh (yeh@tuna.net)
Mon, 15 Mar 1999 22:32:11 -0500


The only thing my inexperienced mind could think of is a meta tag to exclude those you dont want indexed.

At 7:45 PM -0500 3/15/99, Seri Sandeep wrote:
>Hi,
>
>I want to index only html files. Having limit_url_to set to html
>and limit normalised set to ${start_url} almost worked.
>The only problem was some servers (all?) interpret a URL ending
>in a / as /index.html and many authors use this to skip the
>index.html. Any ideas about how to get around this?
>
>Thanks,
>Sandeep
>
>------------------------------------
>To unsubscribe from the htdig mailing list, send a message to
>htdig@htdig.org containing the single word "unsubscribe" in
>the SUBJECT of the message.

------------------------------------
To unsubscribe from the htdig mailing list, send a message to
htdig@htdig.org containing the single word "unsubscribe" in
the SUBJECT of the message.



This archive was generated by hypermail 2.0b3 on Wed Mar 17 1999 - 10:05:12 PST