[htdig] htdig keeling over...


denis filipetti (denis@world.std.com)
Tue, 02 Feb 1999 20:46:04 -0500


--=====================_11783458==_.ALT
Content-Type: text/plain; charset="us-ascii"

Hi Folks, We've been going great guns with ht/dig. Until the other day ! We
can
no longer crawl our servlet created pages. This is a development system, so
changes are not unexpected. It's not clear what has changed between now and
then, however. I have see this symptom occasionally, but it alway went away
before it became a nuisance. I have not recompiled ht/dig in a long time. I am
using 3.1.0b4 on a Win95 box with Cygnus B20. Anybody have any ideas about
this
? Follows is a few pieces of info, I think I have included everything of
use...
Thanks, Denis denis@world.std.com ************************ This is the output
from a htdig with many -v's: New server: devel1, 80 Retrieval command for
http://devel1/robots.txt: GET /robots.txt HTTP/1.0 User-Agent: htdig/3.1.0b4
(unconfigured@htdig.searchengine.maintainer) Host: devel1 Header line:
HTTP/1.1
404 Object Not Found Header line: Server: Microsoft-IIS/4.0 Header line: Date:
Wed, 03 Feb 1999 01:12:44 GMT Header line: Content-Length: 461 Header line:
Content-Type: text/html Header line: returnStatus = 1 pick: devel1:80, #
servers = 1 0:0:0:http://devel1/cpg.jrun?pageId=999: Retrieval command for
http://devel1/cpg.jrun?pageId=999: GET /cpg.jrun?pageId=999 HTTP/1.0
User-Agent: htdig/3.1.0b4 (unconfigured@htdig.searchengine.maintainer) Host:
devel1 Header line: HTTP/1.1 200 OK Header line: Server: Microsoft-IIS/4.0
Header line: Date: Wed, 03 Feb 1999 01:12:44 GMT Header line: Content-Type:
text/html Header line: Cache-Control: no-cache="set-cookie,set-cookie2" Header
line: Last-Modified: 27 Jan 1999 01:12:44 GMT [main]
C:\OPT\WWW\HTDIG\BIN\HTDIG.EXE 1427 (0) handle_exceptions: Exception:
STATUS_ACCESS_VIOLATION [main] HTDIG 1427 (0) handle_exceptions: Dumping stack
trace to HTDIG.EXE.core ********************** This is the contents of
HTDIG.EXE.core: [main] HTDIG 1428 (0) exception: trapped! [main] HTDIG 1428
(0)
exception: code 0xC0000005 at 0x6105520C [main] HTDIG 1428 (1) exception: ax
0x265B840 bx 0x61054EE4 cx 0x0 dx 0x116DB78 [main] HTDIG 1428 (0)
exception: si
0x0 di 0x401B2B bp 0x265B794 sp 0x265B728 [main] HTDIG 1428 (0) exception:
exception is: STATUS_ACCESS_VIOLATION [main] HTDIG 1428 (0) stack: Stack
trace:
[main] HTDIG 1428 (0) stack: frame 0: sp = 0x265B520, pc = 0x6100A2C3 [main]
HTDIG 1428 (0) stack: frame 1: sp = 0x265B55C, pc = 0xBFF7663C [main] HTDIG
1428 (0) stack: frame 2: sp = 0x265B580, pc = 0xBFF859D9 [main] HTDIG 1428 (0)
stack: frame 3: sp = 0x265B618, pc = 0xFFECBAD7 [main] HTDIG 1428 (0) stack:
frame 4: sp = 0x265B794, pc = 0x401C30 [main] HTDIG 1428 (0) stack: frame
5: sp
= 0x265B890, pc = 0x4029D9 [main] HTDIG 1428 (0) stack: frame 6: sp =
0x265B8FC, pc = 0x402548 [main] HTDIG 1428 (0) stack: frame 7: sp = 0x265FA18,
pc = 0x408EC6 [main] HTDIG 1428 (0) stack: frame 8: sp = 0x265FB14, pc =
0x40897E [main] HTDIG 1428 (0) stack: frame 9: sp = 0x265FB44, pc = 0x40D8E4
[main] HTDIG 1428 (0) stack: frame 10: sp = 0x265FD98, pc = 0x61004402 [main]
HTDIG 1428 (0) stack: frame 11: sp = 0x265FE00, pc = 0x61004420 [main] HTDIG
1428 (0) stack: frame 12: sp = 0x265FE0C, pc = 0x466B86 [main] HTDIG 1428 (0)
stack: frame 13: sp = 0x265FE1C, pc = 0x40103A [main] HTDIG 1428 (0) stack:
frame 14: sp = 0x265FE38, pc = 0xBFF88F75 [main] HTDIG 1428 (0) stack: frame
15: sp = 0x265FF78, pc = 0xBFF88E23 [main] HTDIG 1428 (0) stack: End of stack
trace (more stack frames may be present) ********************** This is the
output from a "GET /cpg.jrun?pageId=999 HTTP/1.0" done by hand: HTTP/1.1
200 OK
Server: Microsoft-IIS/4.0 Date: Wed, 03 Feb 1999 00:48:53 GMT Content-Type:
text/html Cache-Control: no-cache="set-cookie,set-cookie2" Last-Modified: 27
Jan 1999 00:48:53 GMT Set-Cookie: jrunsessionid=918002933375227520; path=/
Expires: Thu, 01 Dec 1994 16:00:00 GMT HEAD> snip....

--=====================_11783458==_.ALT
Content-Type: text/html; charset="us-ascii"

Hi Folks,

        We've been going great guns with ht/dig. Until the other day !
We can no longer crawl our servlet created pages. This is a
development system, so changes are not unexpected. It's not clear what
has changed between now and then, however. I have see this symptom
occasionally, but it alway went away before it became a nuisance. I
have not recompiled ht/dig in a long time. I am using 3.1.0b4 on a
Win95 box with Cygnus B20.

        Anybody have any ideas about this ? Follows is a few pieces of
info, I think I have included everything of use...

Thanks,
Denis

denis@world.std.com

************************
This is the output from a htdig with many -v's:

New server: devel1, 80
Retrieval command for http://devel1/robots.txt: GET /robots.txt
HTTP/1.0
User-Agent: htdig/3.1.0b4 (unconfigured@htdig.searchengine.maintainer)
Host: devel1

Header line: HTTP/1.1 404 Object Not Found
Header line: Server: Microsoft-IIS/4.0
Header line: Date: Wed, 03 Feb 1999 01:12:44 GMT
Header line: Content-Length: 461
Header line: Content-Type: text/html
Header line:
returnStatus = 1
pick: devel1:80, # servers = 1
0:0:0:http://devel1/cpg.jrun?pageId=999: Retrieval command for
http://devel1/cpg.jrun?pageId=999: GET /cpg.jrun?pageId=999 HTTP/1.0
User-Agent: htdig/3.1.0b4 (unconfigured@htdig.searchengine.maintainer)
Host: devel1

Header line: HTTP/1.1 200 OK
Header line: Server: Microsoft-IIS/4.0
Header line: Date: Wed, 03 Feb 1999 01:12:44 GMT
Header line: Content-Type: text/html
Header line: Cache-Control: no-cache="set-cookie,set-cookie2"
Header line: Last-Modified: 27 Jan 1999 01:12:44 GMT
[main] C:\OPT\WWW\HTDIG\BIN\HTDIG.EXE 1427 (0) handle_exceptions:
Exception: STATUS_ACCESS_VIOLATION
[main] HTDIG 1427 (0) handle_exceptions: Dumping stack trace to
HTDIG.EXE.core

**********************

This is the contents of HTDIG.EXE.core:

[main] HTDIG 1428 (0) exception: trapped!
[main] HTDIG 1428 (0) exception: code 0xC0000005 at 0x6105520C
[main] HTDIG 1428 (1) exception: ax 0x265B840 bx 0x61054EE4 cx 0x0 dx
0x116DB78
[main] HTDIG 1428 (0) exception: si 0x0 di 0x401B2B bp 0x265B794 sp
0x265B728
[main] HTDIG 1428 (0) exception: exception is: STATUS_ACCESS_VIOLATION
[main] HTDIG 1428 (0) stack: Stack trace:
[main] HTDIG 1428 (0) stack: frame 0: sp = 0x265B520, pc = 0x6100A2C3
[main] HTDIG 1428 (0) stack: frame 1: sp = 0x265B55C, pc = 0xBFF7663C
[main] HTDIG 1428 (0) stack: frame 2: sp = 0x265B580, pc = 0xBFF859D9
[main] HTDIG 1428 (0) stack: frame 3: sp = 0x265B618, pc = 0xFFECBAD7
[main] HTDIG 1428 (0) stack: frame 4: sp = 0x265B794, pc = 0x401C30
[main] HTDIG 1428 (0) stack: frame 5: sp = 0x265B890, pc = 0x4029D9
[main] HTDIG 1428 (0) stack: frame 6: sp = 0x265B8FC, pc = 0x402548
[main] HTDIG 1428 (0) stack: frame 7: sp = 0x265FA18, pc = 0x408EC6
[main] HTDIG 1428 (0) stack: frame 8: sp = 0x265FB14, pc = 0x40897E
[main] HTDIG 1428 (0) stack: frame 9: sp = 0x265FB44, pc = 0x40D8E4
[main] HTDIG 1428 (0) stack: frame 10: sp = 0x265FD98, pc = 0x61004402
[main] HTDIG 1428 (0) stack: frame 11: sp = 0x265FE00, pc = 0x61004420
[main] HTDIG 1428 (0) stack: frame 12: sp = 0x265FE0C, pc = 0x466B86
[main] HTDIG 1428 (0) stack: frame 13: sp = 0x265FE1C, pc = 0x40103A
[main] HTDIG 1428 (0) stack: frame 14: sp = 0x265FE38, pc = 0xBFF88F75
[main] HTDIG 1428 (0) stack: frame 15: sp = 0x265FF78, pc = 0xBFF88E23
[main] HTDIG 1428 (0) stack: End of stack trace (more stack frames may be
present)

**********************
This is the output from a "GET /cpg.jrun?pageId=999 HTTP/1.0" done by
hand:

HTTP/1.1 200 OK
Server: Microsoft-IIS/4.0
Date: Wed, 03 Feb 1999 00:48:53 GMT
Content-Type: text/html
Cache-Control: no-cache="set-cookie,set-cookie2"
Last-Modified: 27 Jan 1999 00:48:53 GMT
Set-Cookie: jrunsessionid=918002933375227520; path=/
Expires: Thu, 01 Dec 1994 16:00:00 GMT

HEAD> Editor's Introduction snip....

--=====================_11783458==_.ALT--

------------------------------------
To unsubscribe from the htdig mailing list, send a message to
htdig@htdig.org containing the single word "unsubscribe" in
the SUBJECT of the message.

-------



This archive was generated by hypermail 2.0b3 on Wed Feb 10 1999 - 17:09:05 PST