Re: htdig: problems indexing site


Zachariah Baum (zack@studioarchetype.com)
Mon, 11 Jan 1999 11:24:04 -0800


ghutchis@wso.williams.edu said:
> >When I run the script, it only indexes the first page, which outputs
> a page
> with links. I don't have it referencing the page through the
> filesystem,
> so it should be whacking at the web server to get the page output. >
> Here's the rundig output: > >New server: www.foo.com, 80 >0:0:0:http://
> www.foo.com/index.php3: ---------------------------------- >size =
> 16450

> I'd take a look at the debugging info. The best way to do this is to
> run htdig with something like "-vvv" This will give you some progress
> as it parses the file and (hopefully) give some input as to why it's
> ignoring the links.

Thanks for your help! muchly appreciated.

Maybe it would be better if the default rundig script didn't have the
   "if ("$1" == "-v")" ... stuff, and instead had:
/opt/www/htdig/bin/htdig -i $1 -s
/opt/www/htdig/bin/htmerge $1 -s
/opt/www/htdig/bin/htnotify $1

???

Anyway, I'm looking at the debug output, and if I still can't figure it (it
  looks good though), I'll email again.

-- 

Yes is a BARGAIN No is a TURNOFF - Wire --Zachariah - Studio Archetype - 415-659-4435 - mailto:zack@studioarchetype.com

---------------------------------------------------------------------- To unsubscribe from the htdig mailing list, send a message to htdig-request@sdsu.edu containing the single word "unsubscribe" in the body of the message.



This archive was generated by hypermail 2.0b3 on Wed Jan 13 1999 - 09:13:04 PST