From owner-freebsd-isp Tue Oct 10 11:43:39 2000 Delivered-To: freebsd-isp@freebsd.org Received: from mx1.thebiz.net (mx1.thebiz.net [216.238.0.20]) by hub.freebsd.org (Postfix) with SMTP id EDAE037B503 for ; Tue, 10 Oct 2000 11:43:32 -0700 (PDT) Received: (qmail 11633 invoked from network); 10 Oct 2000 14:43:26 -0400 Received: from mail1.backend.thebiz.net (HELO mail1.thebiz.net) (172.16.0.179) by mx1.backend.thebiz.net with SMTP; 10 Oct 2000 14:43:26 -0400 Received: (qmail 17675 invoked by uid 0); 10 Oct 2000 14:43:26 -0400 Received: from unknown (HELO shell1.thebiz.net) (216.238.35.75) by mail.thebiz.net with SMTP; 10 Oct 2000 14:43:26 -0400 Date: Tue, 10 Oct 2000 14:43:28 -0400 (EDT) From: X-Sender: tom@shell1.thebiz.net To: freebsd-isp@freebsd.org Subject: Mysterious Lockups (fwd) Message-ID: MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII Sender: owner-freebsd-isp@FreeBSD.ORG Precedence: bulk X-Loop: FreeBSD.org No one bit on this on the questions group or the alpha group so maybe you guys may have some insite for me. Thanks. ---------- Forwarded message ---------- Hello All, We have a couple of webservers that are in production that are getting hosed on a regular basis and I'm at a loss right now on what the problem is. At first we thought it was the way that our logserver was dealing with the logging but we started logging locally and that did not fix the issue. This is a compaq Alpha DS10 doing diskless booting. The apache setup is basically right out of the box other then the option for mass virtual hosting and a patch to deal with our hashed style of user directories. I've included the output of the netstat right after it got hosed as well as the kernel and apache information. Some other info is that this machine has a few aliased IP adresses to support other ISPs on the local loopback device. These machines sit behind a Foundry ServerIron / FastIron for load balancing. Public side goes through the Foundry and the private side goes through a Cisco Catalyst 4000. Any help or thoughts on this would be great. Thanks a bunch! Server version: Apache/1.3.12 Ben-SSL/1.39 (Unix) Server built: May 31 2000 10:07:41 FreeBSD web2.thebiz.net 4.0-RELEASE FreeBSD 4.0-RELEASE #0: Tue Jul 11 13:35:02 EDT 2000 maz@web1.thebiz.net:/usr/src/sys/compile/DISKLESS-DS10 alpha Active Internet connections (including servers) Proto Recv-Q Send-Q Local Address Foreign Address (state) tcp4 0 4 172.16.0.70.23 172.16.0.20.45984 ESTABLISHED tcp4 481 0 216.238.35.206.80 205.188.209.204.60080 CLOSE_WAIT tcp4 378 0 216.238.35.204.80 24.95.170.63.1088 ESTABLISHED tcp4 261 0 216.238.35.204.80 137.165.14.30.1068 ESTABLISHED tcp4 0 0 216.238.35.204.80 63.166.164.200.61407 CLOSE_WAIT tcp4 0 0 216.238.35.204.80 209.185.143.138.44638 CLOSE_WAIT tcp4 166 0 216.238.35.204.80 209.185.143.138.63642 CLOSE_WAIT tcp4 0 0 216.238.35.204.80 63.21.189.209.1093 CLOSE_WAIT tcp4 355 0 216.238.35.204.80 63.99.105.163.8847 ESTABLISHED tcp4 188 0 216.238.35.206.80 216.35.103.51.52629 CLOSE_WAIT tcp4 332 0 216.238.35.204.80 63.99.105.163.9335 ESTABLISHED tcp4 335 0 216.238.35.204.80 63.99.105.163.9334 ESTABLISHED tcp4 340 0 216.238.35.204.80 63.99.105.163.9333 ESTABLISHED tcp4 335 0 216.238.35.204.80 63.99.105.163.9320 ESTABLISHED tcp4 335 0 216.238.35.204.80 63.99.105.163.9319 ESTABLISHED tcp4 347 0 216.238.35.204.80 63.99.105.163.9317 ESTABLISHED tcp4 148 0 216.238.35.206.80 208.171.252.37.4659 CLOSE_WAIT tcp4 296 0 216.238.35.204.80 24.29.59.89.2119 CLOSE_WAIT tcp4 366 0 216.238.35.204.80 12.34.109.82.43747 ESTABLISHED tcp4 221 0 216.238.35.204.80 209.4.252.235.3592 ESTABLISHED tcp4 270 0 216.238.35.206.80 149.106.33.22.1062 CLOSE_WAIT tcp4 335 0 216.238.35.204.80 63.99.105.163.1970 CLOSE_WAIT tcp4 340 0 216.238.35.204.80 63.99.105.163.1968 CLOSE_WAIT tcp4 332 0 216.238.35.204.80 63.99.105.163.1967 CLOSE_WAIT tcp4 197 0 216.238.35.206.80 216.35.103.53.53678 CLOSE_WAIT tcp4 399 0 216.238.35.204.80 212.125.82.57.18666 ESTABLISHED tcp4 316 0 216.238.35.204.80 24.29.59.89.2117 CLOSE_WAIT tcp4 261 0 216.238.35.204.80 208.17.2.40.1033 CLOSE_WAIT tcp4 0 0 216.238.35.70.80 216.238.9.82.2620 CLOSE_WAIT tcp4 0 0 216.238.35.204.80 216.238.9.82.2618 CLOSE_WAIT tcp4 68 0 216.238.35.204.80 216.15.84.168.38018 CLOSE_WAIT tcp4 326 0 216.238.35.204.80 38.151.70.230.5364 CLOSE_WAIT tcp4 270 0 216.238.35.206.80 149.106.33.22.1061 CLOSE_WAIT tcp4 544 0 216.238.35.204.80 202.61.190.5.4021 CLOSE_WAIT tcp4 187 0 216.238.35.206.80 216.35.103.53.52309 CLOSE_WAIT tcp4 565 0 216.238.35.206.80 194.201.24.172.20488 CLOSE_WAIT tcp4 342 0 216.238.35.204.80 63.99.105.163.63617 CLOSE_WAIT tcp4 355 0 216.238.35.204.80 63.99.105.163.63616 CLOSE_WAIT tcp4 341 0 216.238.35.204.80 63.99.105.163.63615 CLOSE_WAIT tcp4 341 0 216.238.35.204.80 63.99.105.163.63613 CLOSE_WAIT tcp4 68 0 216.238.35.204.80 216.15.84.168.38012 CLOSE_WAIT tcp4 273 0 216.238.35.204.80 205.188.208.203.9694 CLOSE_WAIT tcp4 381 0 216.238.35.204.80 207.198.35.37.64434 CLOSE_WAIT tcp4 187 0 216.238.35.206.80 216.35.103.53.50211 CLOSE_WAIT tcp4 273 0 216.238.35.204.80 205.188.208.203.6938 CLOSE_WAIT tcp4 334 0 216.238.35.204.80 216.238.225.56.1403 ESTABLISHED tcp4 68 0 216.238.35.204.80 216.15.84.168.38007 CLOSE_WAIT tcp4 424 0 216.238.35.206.80 24.131.134.76.1213 CLOSE_WAIT tcp4 292 0 216.238.35.204.80 216.238.225.56.1402 CLOSE_WAIT tcp4 434 0 216.238.35.206.80 212.1.141.191.1570 CLOSE_WAIT tcp4 149 0 216.238.35.206.80 212.1.128.63.33288 CLOSE_WAIT tcp4 261 0 216.238.35.204.80 216.175.235.66.1825 CLOSE_WAIT tcp4 315 0 216.238.35.204.80 209.198.114.237.1263 CLOSE_WAIT tcp4 0 0 216.238.35.204.80 209.185.143.138.53172 CLOSE_WAIT tcp4 250 0 216.238.35.204.80 64.41.254.25.1895 CLOSE_WAIT tcp4 381 0 216.238.35.204.80 207.198.35.37.63567 CLOSE_WAIT tcp4 216 0 216.238.35.204.80 216.35.116.93.52489 CLOSE_WAIT tcp4 261 0 216.238.35.204.80 216.238.1.32.2854 CLOSE_WAIT tcp4 170 0 216.238.35.206.80 209.67.206.127.52954 CLOSE_WAIT tcp4 170 0 216.238.35.206.80 209.67.206.126.51861 CLOSE_WAIT tcp4 381 0 216.238.35.204.80 207.198.35.37.63460 CLOSE_WAIT tcp4 274 0 216.238.35.204.80 205.247.157.99.1614 CLOSE_WAIT tcp4 182 0 216.238.35.204.80 209.185.143.138.49748 CLOSE_WAIT tcp4 148 0 216.238.35.206.80 208.171.252.34.4145 CLOSE_WAIT tcp4 255 0 216.238.35.204.80 205.188.208.203.57187 CLOSE_WAIT tcp4 0 0 216.238.35.204.80 209.185.143.138.46399 CLOSE_WAIT tcp4 170 0 216.238.35.204.80 208.184.66.9.1379 CLOSE_WAIT tcp4 155 0 216.238.35.204.80 208.184.66.9.1378 CLOSE_WAIT tcp4 320 0 216.238.35.204.80 213.189.83.100.43578 CLOSE_WAIT tcp4 387 0 216.238.35.204.80 128.119.121.177.1061 CLOSE_WAIT tcp4 155 0 216.238.35.204.80 208.184.66.9.1094 CLOSE_WAIT tcp4 0 0 216.238.35.204.80 209.185.143.138.57149 CLOSE_WAIT tcp4 226 0 216.238.35.204.80 216.35.116.93.51897 CLOSE_WAIT tcp4 182 0 216.238.35.204.80 209.185.143.138.53529 CLOSE_WAIT tcp4 387 0 216.238.35.204.80 128.119.121.177.1031 CLOSE_WAIT tcp4 261 0 216.238.35.204.80 216.175.235.66.1823 CLOSE_WAIT tcp4 375 0 216.238.35.204.80 199.184.22.2.40832 ESTABLISHED tcp4 261 0 216.238.35.204.80 208.48.238.149.3535 CLOSE_WAIT tcp4 261 0 216.238.35.204.80 208.48.238.149.3534 CLOSE_WAIT tcp4 216 0 216.238.35.204.80 216.35.103.62.62755 CLOSE_WAIT tcp4 261 0 216.238.35.204.80 208.48.238.149.3533 CLOSE_WAIT tcp4 180 0 216.238.35.204.80 209.185.143.138.62329 CLOSE_WAIT tcp4 261 0 216.238.35.204.80 216.175.235.66.1821 CLOSE_WAIT tcp4 261 0 216.238.35.204.80 216.175.235.66.1819 CLOSE_WAIT tcp4 261 0 216.238.35.204.80 216.175.235.66.1817 CLOSE_WAIT tcp4 68 0 216.238.35.204.80 209.133.121.160.57333 CLOSE_WAIT tcp4 226 0 216.238.35.204.80 216.35.103.62.62049 CLOSE_WAIT tcp4 0 0 216.238.35.70.80 216.238.9.82.2462 CLOSE_WAIT tcp4 0 0 216.238.35.204.80 216.238.9.82.2460 CLOSE_WAIT tcp4 588 0 216.238.35.206.80 211.117.39.52.18604 CLOSE_WAIT tcp4 0 0 216.238.35.204.80 199.179.123.68.63172 CLOSE_WAIT tcp4 242 0 216.238.35.206.80 64.196.60.70.1130 CLOSE_WAIT tcp4 191 0 216.238.35.206.80 216.35.103.56.50988 CLOSE_WAIT tcp4 357 0 216.238.35.204.80 172.165.74.108.1199 CLOSE_WAIT tcp4 0 17520 216.238.35.206.80 168.221.7.27.1621 CLOSE_WAIT tcp4 0 5950 216.238.35.206.80 216.35.103.56.49103 LAST_ACK tcp4 0 542 216.238.35.204.80 212.7.60.98.1870 LAST_ACK tcp4 0 17520 216.238.35.206.80 209.240.220.150.59419 CLOSE_WAIT tcp4 0 11794 216.238.35.204.80 216.175.235.66.1815 LAST_ACK tcp4 0 307 216.238.35.204.80 208.184.66.9.4700 LAST_ACK tcp4 0 143 216.238.35.204.80 24.131.134.49.4031 LAST_ACK tcp4 0 307 216.238.35.204.80 208.184.66.9.4530 LAST_ACK tcp4 0 2644 216.238.35.206.80 208.171.252.97.2157 LAST_ACK tcp4 0 17520 216.238.35.206.80 216.35.103.71.50336 LAST_ACK tcp4 0 10921 216.238.35.204.80 205.247.157.86.1101 LAST_ACK tcp4 0 4626 216.238.35.206.80 152.163.189.68.34578 LAST_ACK tcp4 0 8319 216.238.35.204.80 216.35.116.103.50498 LAST_ACK tcp4 0 11794 216.238.35.204.80 172.165.74.108.1134 LAST_ACK tcp4 0 4626 216.238.35.206.80 152.163.189.68.31101 LAST_ACK tcp4 0 11794 216.238.35.204.80 24.29.59.89.2104 LAST_ACK tcp4 0 0 216.238.35.204.80 216.238.225.56.1399 LAST_ACK tcp4 0 0 216.238.35.204.80 216.238.225.56.1398 LAST_ACK tcp4 0 0 216.238.35.204.80 216.238.225.56.1397 LAST_ACK tcp4 0 4096 216.238.35.204.80 216.238.225.56.1396 LAST_ACK tcp4 0 458 216.238.35.204.80 216.35.116.103.49617 LAST_ACK tcp4 0 0 216.238.35.204.80 216.77.225.224.24630 FIN_WAIT_2 tcp4 0 170 216.238.35.204.80 209.185.143.138.47035 LAST_ACK tcp4 0 11794 216.238.35.204.80 209.133.121.160.57120 LAST_ACK tcp4 0 11368 216.238.35.204.80 38.240.127.3.1112 LAST_ACK tcp4 0 17520 216.238.35.206.80 216.238.225.156.1402 LAST_ACK tcp4 0 11794 216.238.35.204.80 24.29.59.89.2102 LAST_ACK tcp4 0 4626 216.238.35.206.80 152.163.189.68.27637 LAST_ACK tcp4 0 0 216.238.35.204.80 216.77.225.224.24631 FIN_WAIT_2 tcp4 0 0 216.238.35.206.80 136.215.199.3.3660 LAST_ACK tcp4 0 8196 216.238.35.204.80 63.53.78.178.2246 LAST_ACK tcp4 0 4096 216.238.35.206.80 194.19.141.241.3256 LAST_ACK tcp4 0 4096 216.238.35.206.80 194.19.141.241.3249 LAST_ACK tcp4 0 0 216.238.35.204.80 24.29.72.189.1083 LAST_ACK tcp4 0 540 216.238.35.206.80 216.35.116.108.38090 LAST_ACK tcp4 0 4096 216.238.35.206.80 194.19.141.241.3167 LAST_ACK tcp4 0 0 216.238.35.206.80 128.59.142.35.1038 LAST_ACK tcp4 0 0 216.238.35.206.80 136.215.199.3.1787 LAST_ACK tcp4 0 170 216.238.35.204.80 209.185.143.138.45445 LAST_ACK tcp4 0 4096 216.238.35.206.80 194.19.141.241.3146 LAST_ACK tcp4 0 170 216.238.35.204.80 209.185.143.138.57109 LAST_ACK tcp4 0 11794 216.238.35.204.80 209.133.121.160.57085 LAST_ACK tcp4 0 0 216.238.35.204.80 216.238.9.82.2326 LAST_ACK tcp4 0 0 216.238.35.70.22 *.* LISTEN tcp4 0 0 172.16.0.70.22 *.* LISTEN tcp4 0 0 *.80 *.* LISTEN tcp4 0 0 *.443 *.* LISTEN tcp4 0 0 172.16.0.70.23 *.* LISTEN tcp4 0 0 172.16.0.70.21 *.* LISTEN tcp4 0 0 *.111 *.* LISTEN udp4 0 0 172.16.0.70.985 172.16.0.50.2049 udp4 0 0 172.16.0.70.994 172.16.0.2.2049 udp4 0 0 172.16.0.70.1000 172.16.0.2.2049 udp4 0 0 172.16.0.70.1006 172.16.0.4.2049 udp4 0 0 172.16.0.70.1012 172.16.0.2.2049 udp4 0 0 *.111 *.* udp4 0 0 172.16.0.70.1023 172.16.0.4.2049 Active UNIX domain sockets Address Type Recv-Q Send-Q Inode Conn Refs Nextref Addr fffffe000ec89f80 stream 0 0 fffffe000ec0d120 0 0 0 /tmp/gcache_port -- Tom Holmes To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-questions" in the body of the message To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-isp" in the body of the message