Date: Wed, 25 Jul 2007 12:05:04 +0200 From: Gergely CZUCZY <phoemix@harmless.hu> To: Pound Mailing List <pound@apsis.ch> Cc: freebsd-net@freebsd.org Subject: backends periodically rendered DEAD Message-ID: <20070725100504.GA24034@harmless.hu>
next in thread | raw e-mail | index | archive | help
[-- Attachment #1 --]
Hello,
I'm testing pound at the moment, and running paralelly around 15-18
apache benchmarks for a session-tracking test.
However pound keeps on losing the backends periodically and it
restores them a few seconds later they come back, and go back
to DEAD again.
It's a FreeBSD 6.2-p6. While the backends are marked as DEAD
I'm unable to reach them from a browser (say, elinks) directly.
FreeBSD lvs1.in.publishing.hu 6.2-RELEASE-p6 FreeBSD 6.2-RELEASE-p6 #1: Tue Jul 24 08:07:07 UTC 2007 toor@pointyhat.office:/usr/obj/usr/src/sys/LVS i386
it's like this:
0. http Listener 192.168.4.55:80 a
0. Service active (0)
0. Backend PF_INET 10.0.0.1:80 active (7 27125.432 sec) DEAD
1. Service active (0)
0. Backend PF_INET 10.0.0.1:80 active (7 32400.306 sec) DEAD
1. Backend PF_INET 10.0.0.2:80 active (2 0.000 sec) DEAD
2. Backend PF_INET 10.0.0.3:80 active (2 26940.430 sec) DEAD
I've got log messages like:
Jul 25 11:54:00 lvs1 pound: BackEnd 10.0.0.1:80 resurrect
Jul 25 11:54:00 lvs1 pound: BackEnd 10.0.0.3:80 resurrect
Jul 25 11:54:05 lvs1 pound: backend 10.0.0.1:80 connect: Operation not permitted
Jul 25 11:54:05 lvs1 last message repeated 27 times
Jul 25 11:54:05 lvs1 pound: no back-end "GET /phpinfo-lycos.html HTTP/1.0" from 192.168.4.21
Jul 25 11:53:31 lvs1 pound: error copy server cont: Broken pipe
Jul 25 11:53:34 lvs1 pound: backend 10.0.0.1:80 connect: Operation not permitted
Jul 25 11:53:34 lvs1 pound: backend 10.0.0.3:80 connect: Operation not permitted
Jul 25 11:53:34 lvs1 pound: backend 10.0.0.3:80 connect: Operation not permitted
Jul 25 11:54:27 lvs1 pound: error copy server cont: Broken pipe
Jul 25 11:54:27 lvs1 pound: error copy server cont: Connection reset by peer
Jul 25 11:54:27 lvs1 pound: error copy server cont: Broken pipe
And every combination of these with "no back-end" messages, but I've grepped
those out.
I'm using the pf(4) packet filter, but the log shows no dropped or denied packets.
To be honest, I don't really know where to begin with this issue. I've set the following
sysctls in order to have enough free ports in the range to connect to the web backends:
net.inet.ip.portrange.hilast: 65535
net.inet.ip.portrange.hifirst: 20000
net.inet.ip.portrange.last: 65535
net.inet.ip.portrange.first: 20000
I've googled around, but found nothing really relevant.
What data should I collect to be able to resolve this issue?
I've sent this mail both to the pound and the freebsd-net@ mailing list
because I don't really know where the issue really lies. Please take
this into account in the replies.
Sincerely,
Gergely Czuczy
mailto: gergely.czuczy@harmless.hu
--
Weenies test. Geniuses solve problems that arise.
[-- Attachment #2 --]
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.5 (FreeBSD)
owHNVr9vHEUUNoloJkIiQkSUT45EYsW73r1fcRad4sR2EqOIWPFBCgo0tzt3O9ze
zDIz6+PSEImGIgWioEGCDiqkICF6KkRDQYlEDxJ/BN/s2o6d4ASUFPjn3ux733vv
e+/Ne5++dHLhxOlfHnz/7oX7n33xwrenbg0vTCvn1DiYcrMrVRBHURy0OlG7E7SD
Ns9awyzO4l67F2eXRte+oe11rZxQLhjMS5GQEx+6lbLgUr1Bac6NFa5fuVGwyvbl
NqQttZVOapWQVIVU4uDdwHBlR8IEmyrVmVTjhD6otBNZUBqpHB8WgrEboij0MmNb
56YwZx3EqNSVyog7crmgqZ4CbJk4jkylVC3ADS+gOCduatm4G8SrjJc8hcZQqDRH
wBNLI22IkxXWwsHAGZ5OvL43FMK2noldYfbsTYQoLWlFBQLyQh4KCkJllkphJGJI
eW0U0tIxAxSNP15yCjMjMYOpVHv5gjsA48WcUgRQAzUxjHX9gTlNG5tXNoiPQS+c
2XLnLECuGSGu7mxQL2wFZS+kO7ksxFFfuAErCE+AI1uD1OxVyjNKwDUCPDRejYz2
rg2Nnlk4dN7y+TIJpGlilyiTRqSumMP6vtli18Yh/CmrYSFtDh7CvKqdub15c/PK
ziacOuLjoeOzcUKDSvQZvVkV1OpQtJpEF/FDbw/WqRXhwX85rc1aqVEB85y7UI9G
MhXJSmXNih6+X/+3Jl2xc7ty850+2yGS7dUeY9ITVMiJZ0PahBFFIeXOlXRTWhQc
wosvtcK4txp2wm43WY2IM28QYjsC5Z8K4qmTu4LOR0v1m/rd1YZX2r723tZbmwOK
o9B/xzXAnvxFal2MW92w0275FC81rHuA+HmAt9GSUdiOeo+A1/DHQLQOQ7RgK4qi
x9Rbx6q3j6q3epc6EcI7DIGqwsuxduiIMU3RRHwsmhQkrE5xl+I46XYSWPaF0zRS
Upvc9F15KFj0SWV8uf0XzfaTNLtHNPe644hNtKKCXkK30L7c31GkEA0+TPsoJ9xE
/wxZcOv244X5UqCZM1QAOYnTJ7qhmu4OvCuL10H3SpmXUo10UMxTbcPcTQu6MRhs
r8RhtEh91u/1fIs+rNxWzA5baCft+IgFYQwutVSXc6TK+OsLYSLGq0aDACplKR7R
7zxnop4G2f5fQHYSJOwZiPvX+uuNW94dlKpwNJzDJ2Ge2Rl2BQT4AVXPkKFUTcx6
5K92K2gmXU6Lhypu8aBJl2lYOWr6FwVcghqXa+joyg++elwcDLlydL6zhJkKxh2N
ZIHJ1ej7l771bY7p4Us7M9pjEVzPhJJ4Kvus1rNAHcATQblWmIvLtEWZVuecH0Z+
Zk6UntEsF6aeUEMxlqoJwF/mJK2tRNg47CnsM297pLEbzOAmwzDAoIIcwjeZn6ya
cg5hoXQ1zjHmBOLQxtUiXhe7x7g2tVc1/tGfz/pMDA9macKUcJh3/k8ZeoBaL8TQ
xR2QUK/bbXePlRlJ44Uw2aLoGKGnwxwB2b9y9bjw071ebppcjOodBfXuZ/I+qUYU
Ypcrn9I7mKWUccd9tqoiA/8p6NuLHHl5uBxYXeyKQ7xf3jNrsWc1x1MuCxpqn52G
tb2NDL91XsD20GYBYlmrZb1LWBccG4qUVyizJyQf+rXV/XeFFDak7UJw6Dk+Eazx
TME0T1MYdgc5FWUtzdiOVCnQijk2x+vCjPFE63er9O6ceX+cTmjcHIdpfbyG7XVa
oDuwzjAWBP1WxO4IX8O22QbpOj7AdUsNPaXRIGzqlzsQy420ImSfXD754oJfk/d3
7NMn7v6w8GXnpzOdB6/zl9XZ377u/XVv8urnv/6+8JX5Ob59/7tXzv55a+2jHz8+
c+qP6LV7fwM=
=s6j8
-----END PGP SIGNATURE-----
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20070725100504.GA24034>