Re: [htdig] problems with accents


Philippe Riviere (Philippe.Riviere@Monde-diplomatique.fr)
Thu, 20 May 1999 16:16:20 +0200


>>>>2) searching "étude" does not yield "etudes" and vice-versa. I'd prefer
>>>>it to.
>>>Look at ht://Dig documentation, set your locale to a proper value
>>>(probably fr_FR), get a french dictionary and affix rule file for
>>>the endings algorithm and re-index your site.
>>locale is currently set to fr_FR ; is there something else to add ?
>- Check whether this value is valid on your system.
> It might differ in some cases.

It is valid (I tried and run the short C program posted earlier on the list)

>- You'll only get the plurals etc. if you're using the "endings"
> algorithm. For that to use you need to generate the proper endings.db
> from a dictionary of French words and affix rules. Using the

I have it ; so how do I get the equality between 'é' and 'e' ?
Did I forget to set something ? Do I need to actually RUN htfuzzy ?

Particularities are:
search_algorithm: exact:1 synonyms:0.5 endings:0.1
endings_affix_file: /usr/lib/htdig/francais.aff
endings_dictionary: /usr/lib/htdig/francais.0
pdf_parser: /usr/bin/X11/acroread -toPostScript -pairs
max_doc_size: 5000000
locale: fr_FR

the files are here correctly

> ls -al /usr/lib/htdig
total 2033
drwxrwxr-x 2 root root 1024 Apr 15 15:23 ./
drwxr-xr-x 108 root root 11264 Apr 19 19:07 ../
-rw-r--r-- 1 root root 167 Oct 6 1998 bad_words
-rw-r--r-- 1 root root 923176 Mar 5 1998 english.0
-rw-r--r-- 1 root root 5756 Mar 5 1998 english.aff
-rw-r--r-- 1 root root 200 Mar 5 1998 footer.html
-rw-r--r-- 1 ftp users 540472 Oct 7 1998 francais.0
-rw-r--r-- 1 root root 540472 Oct 7 1998 francais.1
-rw-r--r-- 1 root root 9194 Oct 7 1998 francais.aff
-rw-r--r-- 1 root root 62 Mar 5 1998 synonyms
-rw-r--r-- 1 root root 2048 Oct 8 1998 synonyms.db

> substring matching algorithm should work, too, but will also
> use a lot more execution time which might be significant if
> your document.db is large.

I don't know if this would be too large ?
-rw-r--r-- 1 lists lists 13247488 May 16 06:19 diplo.docdb
-rw-rw-r-- 1 lists lists 11187855 May 16 06:17 diplo.docs
-rw-r--r-- 1 lists lists 228352 May 16 06:19 diplo.docs.index
-rw-r--r-- 1 lists lists 22804 May 16 06:19 diplo.urls.gz
-rw-r--r-- 1 lists lists 28711679 May 16 06:19 diplo.wordlist
-rw-r--r-- 1 lists lists 28932096 May 16 06:19 diplo.words.db

-- Philippe Riviere <Philippe.Riviere@monde-diplomatique.fr>
    Le Monde diplomatique http://www.monde-diplomatique.fr/
    21b, rue Claude-Bernard 75005 Paris tel: 33 1 42 17 37 46

Le Monde diplomatique in English: http://www.monde-diplomatique.fr/en/

------------------------------------
To unsubscribe from the htdig mailing list, send a message to
htdig@htdig.org containing the single word "unsubscribe" in
the SUBJECT of the message.



This archive was generated by hypermail 2.0b3 on Thu May 20 1999 - 06:27:42 PDT