About ht://Dig - from Russia


Vlad Gerasimov (vlad@info.novsu.ac.ru)
Tue, 19 May 1998 10:10:26 +0400


Hello Andrew!!

How are you?
I am Vlad Gerasimov - webmaster www.novgorod.ru www.novsu.ac.ru etc
I use your search program ht://Dig. (testing now :)

Please help me
if i adding new server or page in
start_url - exapmle (added http://www.adm.nov.ru/ )
start_url: http://www.novgorod.ru/ http://www.novsu.ac.ru/
http://chess.novgorod.ru/ http://quake.novgorod.ru/
http://www1.novsu.ac.ru/ http://www.adm.nov.ru/

ht://Dig digged ALL servers (long time), not only one
http://www.adm.nov.ru/
if I write
start_url: http://www.adm.nov.ru/
ht://Dig forget about other servers
I attached my config file

Or if I want make only add to database new page on server?
Where my mistake?

thanks for your time
Vlad Gerasimov

PS. sorry for bad english

#
# Example config file for ht://Dig.
# Last modified 2-Sep-1996 by Andrew Scherpbier
#
# This configuration file is used by all the programs that make up ht://Dig.
# Please refer to the attribute reference manual for more details on what
# can be put into this file. (http://htdig.sdsu.edu/configfile.html)
# Note that most attributes have very reasonable default values so you
# really only have to add attributes here if you want to change the defaults.
#
# What follows are some of the common attributes you might want to change.
#
locale: ru_RU
minimum_word_length: 3
endings_affix_file: /usr/local/internet/www/htdig/common/russian.aff
endings_dictionary: /usr/local/internet/www/htdig/common/russian.sml
maintainer: vlad@novsu.ac.ru
max_hop_count: 7
max_stars: 7
bad_extensions: .wav .mp3 .ra .mid .au .avi .mpg .jpg .gif .tif .tff .zip .arj .gz .Z .hqx .z .tar .rar .exe .com .jpeg .aiff .sit
#
# Specify where the database files need to go. Make sure that there is
# plenty of free disk space available for the databases. They can get
# pretty big.
#
database_dir: /usr/local/internet/www/htdig/db

#
# This specifies the URL where the robot (htdig) will start. You can specify
# multiple URLs here. Just separate them by some whitespace.
# The example here will cause the ht://Dig homepage and related pages to be
# indexed.
#
start_url: http://www.novgorod.ru/ http://www.novsu.ac.ru/ http://chess.novgorod.ru/ http://quake.novgorod.ru/ http://www1.novsu.ac.ru/ http://www.adm.nov.ru/
#http://www.novgorod.ru/ http://www.novsu.ac.ru/ http://chess.novgorod.ru/ http://quake.novgorod.ru/ http://www1.novsu.ac.ru/ http://www.adm.nov.ru/ http://www.telecom.nov.ru/
#
# This attribute limits the scope of the indexing process. The default is to
# set it to the same as the start_url above. This way only pages that are on
# the sites specified in the start_url attribute will be indexed and it will
# reject any URLs that go outside of those sites.
#
# Keep in mind that the value for this attribute is just a list of string
# patterns. As long as URLs contain at least one of the patterns it will be
# seen as part of the scope of the index.
#
limit_urls_to: ${start_url}

#
# If there are particular pages that you definately do NOT want to index, you
# can use the exclude_urls attribute. The value is a list of string patterns.
# If a URL matches any of the patterns, it will NOT be indexed. This is
# useful to exclude things like virtual web trees or database accesses. By
# default, all CGI URLs will be excluded. (Note that the /cgi-bin/ convention
# may not work on your web server. Check the path prefix used on your web
# server.)
#
exclude_urls: /cgi-bin/ .cgi

#
# The excerpts that are displayed in long results rely on stored information
# in the index databases. The compiled default only stores 512 characters of
# text from each document (this excludes any HTML markup...) If you plan on
# using the excerpts you probably want to make this larger. The only concern
# here is that more disk space is going to be needed to store the additional
# information. Since disk space is cheap (! :-)) you might want to set this
# to a value so that a large percentage of the documents that you are going
# to be indexing are stored completely in the database. At SDSU we found
# that by setting this value to about 50k the index would get 97% of all
# documents completely and only 3% was cut off at 50k. You probably want to
# experiment with this value.
# Note that if you want to set this value low, you probably want to set the
# excerpt_show_top attribute to false so that the top excerpt_length characters
# of the document are always shown.
#
max_head_length: 10000

#
# Depending on your needs, you might want to enable some of the fuzzy search
# algorithms. There are several to choose from and you can use them in any
# combination you feel comfortable with. Each algorithm will get a weight
# assigned to it so that in combinations of algorithms, certain algorithms get
# preference over others. Note that the weights only affect the ranking of
# the results, not the actual searching.
# The available algorithms are:
# exact
# endings
# synonyms
# soundex
# metaphone
# By default only the "exact" algorithm is used with weight 1.
# Note that if you are going to use any of the algorithms other than "exact",
# you need to use the htfuzzy program to generate the databases that each
# algorithm requires.
#
search_algorithm: exact:1 synonyms:0.5 endings:0.3 soundex:0.2

#
# The following are used to change the text for the page index.
# The defaults are just boring text numbers. These images spice
# up the result pages quite a bit. (Feel free to do whatever, though)
#
next_page_text: <img src=/search/buttonr.gif border=0 align=middle width=30 height=30 alt=next>
no_next_page_text:
prev_page_text: <img src=/search/buttonl.gif border=0 align=middle width=30 height=30 alt=prev>
no_prev_page_text:
page_number_text: "<img src=/search/button1.gif border=0 align=middle width=30 height=30 alt=1>" \
                        "<img src=/search/button2.gif border=0 align=middle width=30 height=30 alt=2>" \
                        "<img src=/search/button3.gif border=0 align=middle width=30 height=30 alt=3>" \
                        "<img src=/search/button4.gif border=0 align=middle width=30 height=30 alt=4>" \
                        "<img src=/search/button5.gif border=0 align=middle width=30 height=30 alt=5>" \
                        "<img src=/search/button6.gif border=0 align=middle width=30 height=30 alt=6>" \
                        "<img src=/search/button7.gif border=0 align=middle width=30 height=30 alt=7>" \
                        "<img src=/search/button8.gif border=0 align=middle width=30 height=30 alt=8>" \
                        "<img src=/search/button9.gif border=0 align=middle width=30 height=30 alt=9>" \
                        "<img src=/search/button10.gif border=0 align=middle width=30 height=30 alt=10>"
#
# To make the current page stand out, we will put a border arround the
# image for that page.
#
no_page_number_text: "<img src=/search/button1.gif border=2 align=middle width=30 height=30 alt=1>" \
                        "<img src=/search/button2.gif border=2 align=middle width=30 height=30 alt=2>" \
                        "<img src=/search/button3.gif border=2 align=middle width=30 height=30 alt=3>" \
                        "<img src=/search/button4.gif border=2 align=middle width=30 height=30 alt=4>" \
                        "<img src=/search/button5.gif border=2 align=middle width=30 height=30 alt=5>" \
                        "<img src=/search/button6.gif border=2 align=middle width=30 height=30 alt=6>" \
                        "<img src=/search/button7.gif border=2 align=middle width=30 height=30 alt=7>" \
                        "<img src=/search/button8.gif border=2 align=middle width=30 height=30 alt=8>" \
                        "<img src=/search/button9.gif border=2 align=middle width=30 height=30 alt=9>" \
                        "<img src=/search/button10.gif border=2 align=middle width=30 height=30 alt=10>"



This archive was generated by hypermail 2.0b3 on Sat Jan 02 1999 - 16:26:17 PST