Gabriel Fenteany (email@example.com)
Sat, 01 May 1999 07:52:02 -0400
Hi. We have htdig indexing about 300 servers over which we have no control.
A few of these sites are written very poorly and use absolute URLs even for
local paths: e.g. their links might be <a
href="http://theirsite.com/blah.html"> when "blah.html" is in the same
directory as the entry page index file (http://theirsite.com/idnex.html).
Will htdig follow the absolute link to "blah.html" or will it see that it
starts with "http://" and assume it is an external URL and not go to it and
index it? Should I harangue these site maintainers until the change all
these terrible absolute URLs that are local links to relative links?
Thanks for the information!!!
-- Gabriel Fenteany, Ph.D. Post-doctoral Fellow and Maintainer, WWW VL of Cell Biology (http://vl.bwh.harvard.edu)
Cell Biology and Cytoskeleton Group Div. Hematology, Brigham and Women's Hospital Dept. Medicine, Harvard Medical School 221 Longwood Avenue, LMRC 301 Boston, MA 02115 Tel: (617) 278-0390; Fax: (617) 734-2248 Web: http://zk.bwh.harvard.edu ------------------------------------ To unsubscribe from the htdig mailing list, send a message to firstname.lastname@example.org containing the single word "unsubscribe" in the SUBJECT of the message.
This archive was generated by hypermail 2.0b3 on Sat May 01 1999 - 05:08:54 PDT