Re: [htdig] "Deleted, invalid" messages solved


Subject: Re: [htdig] "Deleted, invalid" messages solved
From: Gilles Detillieux (grdetil@scrc.umanitoba.ca)
Date: Wed Jul 26 2000 - 09:17:23 PDT


According to D.J.Adams@soton.ac.uk:
> Now I have to investigate why certain pages are flagged as
> "Deleted, noexcerpt"!

Main causes:
- disallowed in robots.txt
- indexing turned off by meta robots or noindex tags
- no indexable text in documents
- server_max_docs exceeded

-- 
Gilles R. Detillieux              E-mail: <grdetil@scrc.umanitoba.ca>
Spinal Cord Research Centre       WWW:    http://www.scrc.umanitoba.ca/~grdetil
Dept. Physiology, U. of Manitoba  Phone:  (204)789-3766
Winnipeg, MB  R3E 3J7  (Canada)   Fax:    (204)789-3930

------------------------------------ To unsubscribe from the htdig mailing list, send a message to htdig-unsubscribe@htdig.org You will receive a message to confirm this.



This archive was generated by hypermail 2b28 : Tue Jul 25 2000 - 23:15:48 PDT