Re: [htdig] htdig-noindex = nofollow !!!


Frank Martini (fmartini@caddev.com)
Mon, 11 Oct 1999 20:35:13 -0500


How about creating a 'shadow' index, with the Robots tags?

Frank

>
> I asked :
>
>>When I add the tag <META name="htdig-noindex">, HtDig don't index the
> pages,
>>but doesn't FOLLOW the links on them either!
>>
>>Is there another tag or another way to achieve what I want?
>
> Geoff answered :
>
>>This tag does not follow any DTD or relative standard. It has been in
>>the code for a very long time and has always meant exactly that.
>>
>>What you'd like it to use the new standard, the robots META tag:
>><meta name="robots" content="noindex,follow">>>
>
>
> Do you mean "would you", or "why would you"? Well, I would like a tag, maybe
> another one so as not to disturb the people using the current one, that
> would mean "noindex,follow" just like in a robots tag.
>
> I cannot use the robots tag because I want my tables of contents to be
> indexed by external search engines. These pages are relevant for visitors
> coming from outside. But visitors that are already within the site want to
> find the pages that contains the information, not the index pages.
> Furthermore, many of my "menu" pages are framed, and it is a mess when they
> are found and called individually.
>
> But of course, I need HtDig to follow all the links on these menu pages, in
> order to index the pages where the information is.
>
> | Alain Zürcher, Paris, France
> | L'Atelier du Chanteur :
> | http://chanteur.net
>
>
> ------------------------------------
> To unsubscribe from the htdig mailing list, send a message to
> htdig@htdig.org containing the single word unsubscribe in
> the SUBJECT of the message.
>

--
Frank Martini                                 Voice: 713/621-1917
Cadence Development                             FAX: 713/621-1960
5075 Westheimer, Ste. 1266             eMail: fmartini@caddev.com
Houston, Texas 77056       WWW: http://www.CadenceDevelopment.com/

------------------------------------ To unsubscribe from the htdig mailing list, send a message to htdig@htdig.org containing the single word unsubscribe in the SUBJECT of the message.



This archive was generated by hypermail 2.0b3 on Sat Oct 23 1999 - 09:47:46 PDT