Re: htdig: Searching not working?


Colin Viebrock (cmv@privateworld.com)
Thu, 18 Jun 1998 13:34:10 -0400


Also sprach Andrew Scherpbier (at 10:12 AM 6/18/98 -0700) ...
>This is a symptom of a corrupted database. You need to erase the database
>files and build a new index. I have seen this happen before, but I don't
know
>why it happens.
>The messages you see are bogus.

Hrm ... could it have anything to do with the way I re-index the site? My
rundig.sh script is at the end of the message, if you want to have a look.

>BTW, nice customization of ht://Dig!

Thanks! I use PHP for pretty much all my web development. And integrating
htdig is a snap: just parse the text files that it produces!

--- start rundig.sh ---

#! /bin/sh

if [ "$1" = "-v" ]; then
    verbose="-v"
fi

# This is the directory where htdig lives
BASEDIR=/export/htdig

# This is the db dir
DBDIR=$BASEDIR/db/sw98

# This is the name of a temporary report file
REPORT=/tmp/htdig.sw98

# This is who gets the report
REPORT_DEST="cmv@shmooze.net"
export REPORT_DEST

# This is the subject line of the report
SUBJECT="cron: htdig report for SW98"

# This is the name of the conf file to use
CONF=sw98.conf

# This is the directory htdig will use for temporary sort files
TMPDIR=/tmp
export TMPDIR

# This is the PATH used by this script. Change it if you have problems
# with not finding wc or grep.
PATH=/usr/local/bin:/usr/bin:/bin

##### Dig phase
STARTTIME=`date`
echo Start time: $STARTTIME
echo rundig: Start time: $STARTTIME > $REPORT
$BASEDIR/bin/htdig $verbose -s -a -c $BASEDIR/conf/$CONF >> $REPORT
TIME=`date`
echo Done Digging: $TIME
echo rundig: Done Digging: $TIME >> $REPORT

##### Merge Phase
$BASEDIR/bin/htmerge $verbose -s -a -c $BASEDIR/conf/$CONF >> $REPORT
TIME=`date`
echo Done Merging: $TIME
echo rundig: Done Merging: $TIME >> $REPORT

##### Cleanup Phase
# To enable htnotify or the soundex search, uncomment the following lines
# $BASEDIR/bin/htnotify $verbose >>$REPORT
# $BASEDIR/bin/htfuzzy $verbose soundex

# Remove db.wordlist
# And move the work files
rm $DBDIR/db.wordlist
mv $DBDIR/db.docdb.work $DBDIR/db.docdb
mv $DBDIR/db.docs.index.work $DBDIR/db.docs.index
mv $DBDIR/db.words.gdbm.work $DBDIR/db.words.gdbm
END=`date`
echo End time: $END
echo rundig: End time: $END >> $REPORT
echo

# Grab the important statistics from the report file
# All lines begin with htdig: or htmerge:
fgrep "htdig:" $REPORT
echo
fgrep "htmerge:" $REPORT
echo
fgrep "rundig:" $REPORT
echo

WC=`wc -l $REPORT`
echo Total lines in $REPORT: $WC

# Send out the report ...
mail -s "$SUBJECT - $STARTTIME" $REPORT_DEST < $REPORT

# ... and clean up
rm $REPORT

.........................................................................
Colin Viebrock Creative Director - Private World Communciations
cmv@privateworld.com 331 - 67 Mowat Avenue
http://www.privateworld.com Toronto, Ontario, CANADA, M6K 3E3
ICQ: 11386088

                                  The other day, I saw a man, a woman and
                                   two children turn into a corner store.



This archive was generated by hypermail 2.0b3 on Sat Jan 02 1999 - 16:26:34 PST