1:0:http://stagesite.coreon.com/
New server: stagesite.coreon.com, 80
Retrieval command for http://stagesite.coreon.com/robots.txt: GET /robots.txt HTTP/1.0
User-Agent: htdig/3.1.5 (unconfigured@htdig.searchengine.maintainer)
Host: stagesite.coreon.com

Header line: HTTP/1.1 404 Not Found
Header line: Date: Thu, 04 Jan 2001 16:27:48 GMT
Header line: Server: Apache/1.3.12 (Unix) tomcat/1.0 mod_perl/1.24 mod_ssl/2.6.6 OpenSSL/0.9.4
Header line: Connection: close
Header line: Content-Type: text/html; charset=iso-8859-1
Header line: 
returnStatus = 1
 pushed
pick: stagesite.coreon.com, # servers = 1
0:0:0:http://stagesite.coreon.com/: Retrieval command for http://stagesite.coreon.com/: GET / HTTP/1.0
User-Agent: htdig/3.1.5 (unconfigured@htdig.searchengine.maintainer)
Host: stagesite.coreon.com

Header line: HTTP/1.1 200 OK
Header line: Date: Thu, 04 Jan 2001 16:27:48 GMT
Header line: Server: Apache/1.3.12 (Unix) tomcat/1.0 mod_perl/1.24 mod_ssl/2.6.6 OpenSSL/0.9.4
Header line: Last-Modified: Tue, 12 Dec 2000 02:14:53 GMT
Translated Tue, 12 Dec 2000 02:14:53 GMT to 2000-12-12 02:14:53 (100)
And converted to Tue, 12 Dec 2000 02:14:53
Header line: ETag: "48890-dc0-3a358a1d"
Header line: Accept-Ranges: bytes
Header line: Content-Length: 3520
Header line: Connection: close
Header line: Content-Type: text/html
Header line: 
returnStatus = 0
Read 3520 from document
Read a total of 3520 bytes

title: Insite
href: http://stagesite.coreon.com/coreonlib/html/top_index.htm ()

  Rejected: Item in the exclude list: item # 1 length: 11

url rejected: (level 1)http://stagesite.coreon.com/coreonlib/html/top_index.htm
href: http://stagesite.coreon.com/coreonlib/html/main.html ()

  Rejected: Item in the exclude list: item # 1 length: 11

url rejected: (level 1)http://stagesite.coreon.com/coreonlib/html/main.html
 size = 3520
pick: stagesite.coreon.com, # servers = 1
htmerge: Sorting...
htmerge: Merging...

0/http://stagesite.coreon.com/