From owner-freebsd-net@FreeBSD.ORG Wed Jul 25 10:29:37 2007 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 726FF16A418 for ; Wed, 25 Jul 2007 10:29:37 +0000 (UTC) (envelope-from gergely.czuczy@harmless.hu) Received: from marvin.harmless.hu (marvin.harmless.hu [195.56.55.204]) by mx1.freebsd.org (Postfix) with ESMTP id C32EF13C459 for ; Wed, 25 Jul 2007 10:29:36 +0000 (UTC) (envelope-from gergely.czuczy@harmless.hu) Received: from localhost (marvin-mail [192.168.0.2]) by marvin.harmless.hu (Postfix) with ESMTP id F35087C0067; Wed, 25 Jul 2007 12:05:19 +0200 (CEST) X-Virus-Scanned: by amavisd-new-2.4.2 (20060627) (Debian) at harmless.hu Received: from marvin.harmless.hu ([192.168.0.2]) by localhost (marvin.harmless.hu [192.168.0.2]) (amavisd-new, port 10024) with ESMTP id CtihbBXnPN6p; Wed, 25 Jul 2007 12:05:19 +0200 (CEST) Received: from marvin.harmless.hu (localhost [127.0.0.1]) by marvin.harmless.hu (Postfix) with ESMTP id 7B4917C005B; Wed, 25 Jul 2007 12:05:04 +0200 (CEST) Date: Wed, 25 Jul 2007 12:05:04 +0200 From: Gergely CZUCZY To: Pound Mailing List Message-ID: <20070725100504.GA24034@harmless.hu> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=x-unknown; protocol="application/pgp-signature"; boundary="+QahgC5+KEYLbs62" Content-Disposition: inline User-Agent: mutt-ng/devel-r804 (FreeBSD) Cc: freebsd-net@freebsd.org Subject: backends periodically rendered DEAD X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 25 Jul 2007 10:29:37 -0000 --+QahgC5+KEYLbs62 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Hello, I'm testing pound at the moment, and running paralelly around 15-18 apache benchmarks for a session-tracking test. However pound keeps on losing the backends periodically and it restores them a few seconds later they come back, and go back to DEAD again. It's a FreeBSD 6.2-p6. While the backends are marked as DEAD I'm unable to reach them from a browser (say, elinks) directly. FreeBSD lvs1.in.publishing.hu 6.2-RELEASE-p6 FreeBSD 6.2-RELEASE-p6 #1: Tue= Jul 24 08:07:07 UTC 2007 toor@pointyhat.office:/usr/obj/usr/src/sys/LV= S i386 it's like this: 0. http Listener 192.168.4.55:80 a 0. Service active (0) 0. Backend PF_INET 10.0.0.1:80 active (7 27125.432 sec) DEAD 1. Service active (0) 0. Backend PF_INET 10.0.0.1:80 active (7 32400.306 sec) DEAD 1. Backend PF_INET 10.0.0.2:80 active (2 0.000 sec) DEAD 2. Backend PF_INET 10.0.0.3:80 active (2 26940.430 sec) DEAD I've got log messages like: Jul 25 11:54:00 lvs1 pound: BackEnd 10.0.0.1:80 resurrect Jul 25 11:54:00 lvs1 pound: BackEnd 10.0.0.3:80 resurrect Jul 25 11:54:05 lvs1 pound: backend 10.0.0.1:80 connect: Operation not perm= itted Jul 25 11:54:05 lvs1 last message repeated 27 times Jul 25 11:54:05 lvs1 pound: no back-end "GET /phpinfo-lycos.html HTTP/1.0" = =66rom 192.168.4.21 Jul 25 11:53:31 lvs1 pound: error copy server cont: Broken pipe Jul 25 11:53:34 lvs1 pound: backend 10.0.0.1:80 connect: Operation not perm= itted Jul 25 11:53:34 lvs1 pound: backend 10.0.0.3:80 connect: Operation not perm= itted Jul 25 11:53:34 lvs1 pound: backend 10.0.0.3:80 connect: Operation not perm= itted Jul 25 11:54:27 lvs1 pound: error copy server cont: Broken pipe Jul 25 11:54:27 lvs1 pound: error copy server cont: Connection reset by peer Jul 25 11:54:27 lvs1 pound: error copy server cont: Broken pipe And every combination of these with "no back-end" messages, but I've grepped those out. I'm using the pf(4) packet filter, but the log shows no dropped or denied p= ackets. To be honest, I don't really know where to begin with this issue. I've set = the following sysctls in order to have enough free ports in the range to connect to the w= eb backends: net.inet.ip.portrange.hilast: 65535 net.inet.ip.portrange.hifirst: 20000 net.inet.ip.portrange.last: 65535 net.inet.ip.portrange.first: 20000 I've googled around, but found nothing really relevant. What data should I collect to be able to resolve this issue? I've sent this mail both to the pound and the freebsd-net@ mailing list because I don't really know where the issue really lies. Please take this into account in the replies. Sincerely, Gergely Czuczy mailto: gergely.czuczy@harmless.hu --=20 Weenies test. Geniuses solve problems that arise. --+QahgC5+KEYLbs62 Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.5 (FreeBSD) owHNVr9vHEUUNoloJkIiQkSUT45EYsW73r1fcRad4sR2EqOIWPFBCgo0tzt3O9ze zDIz6+PSEImGIgWioEGCDiqkICF6KkRDQYlEDxJ/BN/s2o6d4ASUFPjn3ux733vv e+/Ne5++dHLhxOlfHnz/7oX7n33xwrenbg0vTCvn1DiYcrMrVRBHURy0OlG7E7SD Ns9awyzO4l67F2eXRte+oe11rZxQLhjMS5GQEx+6lbLgUr1Bac6NFa5fuVGwyvbl NqQttZVOapWQVIVU4uDdwHBlR8IEmyrVmVTjhD6otBNZUBqpHB8WgrEboij0MmNb 56YwZx3EqNSVyog7crmgqZ4CbJk4jkylVC3ADS+gOCduatm4G8SrjJc8hcZQqDRH wBNLI22IkxXWwsHAGZ5OvL43FMK2noldYfbsTYQoLWlFBQLyQh4KCkJllkphJGJI eW0U0tIxAxSNP15yCjMjMYOpVHv5gjsA48WcUgRQAzUxjHX9gTlNG5tXNoiPQS+c 2XLnLECuGSGu7mxQL2wFZS+kO7ksxFFfuAErCE+AI1uD1OxVyjNKwDUCPDRejYz2 rg2Nnlk4dN7y+TIJpGlilyiTRqSumMP6vtli18Yh/CmrYSFtDh7CvKqdub15c/PK ziacOuLjoeOzcUKDSvQZvVkV1OpQtJpEF/FDbw/WqRXhwX85rc1aqVEB85y7UI9G MhXJSmXNih6+X/+3Jl2xc7ty850+2yGS7dUeY9ITVMiJZ0PahBFFIeXOlXRTWhQc wosvtcK4txp2wm43WY2IM28QYjsC5Z8K4qmTu4LOR0v1m/rd1YZX2r723tZbmwOK o9B/xzXAnvxFal2MW92w0275FC81rHuA+HmAt9GSUdiOeo+A1/DHQLQOQ7RgK4qi x9Rbx6q3j6q3epc6EcI7DIGqwsuxduiIMU3RRHwsmhQkrE5xl+I46XYSWPaF0zRS Upvc9F15KFj0SWV8uf0XzfaTNLtHNPe644hNtKKCXkK30L7c31GkEA0+TPsoJ9xE /wxZcOv244X5UqCZM1QAOYnTJ7qhmu4OvCuL10H3SpmXUo10UMxTbcPcTQu6MRhs r8RhtEh91u/1fIs+rNxWzA5baCft+IgFYQwutVSXc6TK+OsLYSLGq0aDACplKR7R 7zxnop4G2f5fQHYSJOwZiPvX+uuNW94dlKpwNJzDJ2Ge2Rl2BQT4AVXPkKFUTcx6 5K92K2gmXU6Lhypu8aBJl2lYOWr6FwVcghqXa+joyg++elwcDLlydL6zhJkKxh2N ZIHJ1ej7l771bY7p4Us7M9pjEVzPhJJ4Kvus1rNAHcATQblWmIvLtEWZVuecH0Z+ Zk6UntEsF6aeUEMxlqoJwF/mJK2tRNg47CnsM297pLEbzOAmwzDAoIIcwjeZn6ya cg5hoXQ1zjHmBOLQxtUiXhe7x7g2tVc1/tGfz/pMDA9macKUcJh3/k8ZeoBaL8TQ xR2QUK/bbXePlRlJ44Uw2aLoGKGnwxwB2b9y9bjw071ebppcjOodBfXuZ/I+qUYU Ypcrn9I7mKWUccd9tqoiA/8p6NuLHHl5uBxYXeyKQ7xf3jNrsWc1x1MuCxpqn52G tb2NDL91XsD20GYBYlmrZb1LWBccG4qUVyizJyQf+rXV/XeFFDak7UJw6Dk+Eazx TME0T1MYdgc5FWUtzdiOVCnQijk2x+vCjPFE63er9O6ceX+cTmjcHIdpfbyG7XVa oDuwzjAWBP1WxO4IX8O22QbpOj7AdUsNPaXRIGzqlzsQy420ImSfXD754oJfk/d3 7NMn7v6w8GXnpzOdB6/zl9XZ377u/XVv8urnv/6+8JX5Ob59/7tXzv55a+2jHz8+ c+qP6LV7fwM= =s6j8 -----END PGP SIGNATURE----- --+QahgC5+KEYLbs62--