htdig (start_url)


Ryan Rothert (rrother@primenet.com)
Thu, 02 Oct 1997 08:44:51 -0400


I have about 250 urls in the start_url field.
When I run the rundig program, its constantly on the cpu, but
it looks like nothing at all is happening. This goes on
for over 10 hours.
I have max_hop set to 0 ( I only want to index the first page
of each site )...

here is the last part of the output from strace where it hangs... :

stat("/etc/locale/C/libc.cat", 0xbffff754) = -1 ENOENT (No such file or
directory)
stat("/usr/lib/locale/C/libc.cat", 0xbffff754) = -1 ENOENT (No such file
or directory)
stat("/usr/lib/locale/libc/C", 0xbffff754) = -1 ENOENT (No such file or
directory)
stat("/usr/share/locale/C/libc.cat", 0xbffff754) = -1 ENOENT (No such
file or directory)
stat("/usr/local/share/locale/C/libc.cat", 0xbffff754) = -1 ENOENT (No
such file or directory)
brk(0x8065000) = 0x8065000
open("/usr/share/locale/iso_8859_1/LC_MESSAGES", O_RDONLY) = -1 ENOENT
(No such file or directory)
brk(0x8066000) = 0x8066000
brk(0x8067000) = 0x8067000
access("/home/httpd/html/ryan/htdig//conf/htdig.conf", R_OK) = 0
open("/home/httpd/html/ryan/htdig//conf/htdig.conf", O_RDONLY) = 3
fstat(3, {st_mode=S_IFREG|0644, st_size=13120, ...}) = 0
mmap(0, 4096, PROT_READ|PROT_00
read(3, "#\n# Example config file for ht:"..., 4096) = 4096
WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x40007000

Any thoughts on this one?
Ryan Rothert
rrother@primenet.com



This archive was generated by hypermail 2.0b3 on Sat Jan 02 1999 - 16:25:10 PST