Re: htdig: duplicate userdirs.

Andrew Scherpbier (
Fri, 07 Aug 1998 09:22:15 -0700

Thierry Boudet wrote:
> Hello World.
> The system think that "http://foo/~bar/" and "http://foo/%7Ebar/"
> are differents. In an URL, '%7E' is equivalent to '~'. So, I get
> a _lot_ of duplicates pages in search results.
> Any solution ?
> Thierry Boudet. Igrec communications. Toulouse. France.

I think the simplest solution would be to add '%7e' to the 'exclude_urls'
That way, you only get the URLs with '~'.

Andrew Scherpbier <>
Contigo Software <>
To unsubscribe from the htdig mailing list, send a message to containing the single word "unsubscribe" in
the body of the message.

This archive was generated by hypermail 2.0b3 on Sat Jan 02 1999 - 16:27:17 PST