Date: Thu, 2 Oct 2014 20:19:58 +0200 From: Julien Cigar <jcigar@ulb.ac.be> To: hiren panchasara <hiren@freebsd.org> Cc: "freebsd-net@freebsd.org" <freebsd-net@freebsd.org>, FreeBSD Stable Mailing List <freebsd-stable@freebsd.org> Subject: Re: [jcigar@ulb.ac.be: Listen queue overflow: 8 already in queue awaiting acceptance] Message-ID: <20141002181958.GJ29361@mordor.lan> In-Reply-To: <CALCpEUGjeLo3jid5vb0SxCRM7NBkWe2FdKLAoUM=%2B34ALZs3Vw@mail.gmail.com> References: <20141002164202.GI29361@mordor.lan> <CALCpEUGjeLo3jid5vb0SxCRM7NBkWe2FdKLAoUM=%2B34ALZs3Vw@mail.gmail.com>
next in thread | previous in thread | raw e-mail | index | archive | help
--MqkwUViToTQK+HjE Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Thu, Oct 02, 2014 at 10:24:13AM -0700, hiren panchasara wrote: > On Thu, Oct 2, 2014 at 9:42 AM, Julien Cigar <jcigar@ulb.ac.be> wrote: > > sorry for cross-posting, I'm forwarding this as it seems that part of > > the problem is also related to: > > https://lists.freebsd.org/pipermail/freebsd-net/2014-September/039664.h= tml >=20 > Umm, this looks like a different problem than the subject of this email. yes and no, seems the same hardware (HP and igb) and I have also some "requests for mbufs denied" (https://dpaste.de/t8kJ/raw) without any reasons. I should add that the box hanged a week ago and I had to do a hard reboot, I have the feeling that it's somewhat related to this problem .. > > > > I also wonder if something has been fixed in -STABLE in this area .. > > > > (please keep me in CC as I'm not subscribed on freebsd-net@ an > > freebsd-stable@) > > > > -- > > Julien Cigar > > Belgian Biodiversity Platform (http://www.biodiversity.be) > > PGP fingerprint: EEF9 F697 4B68 D275 7B11 6A25 B2BB 3710 A204 23C0 > > No trees were killed in the creation of this message. > > However, many electrons were terribly inconvenienced. > > > > > > ---------- Forwarded message ---------- > > From: Julien Cigar <jcigar@ulb.ac.be> > > To: freebsd-questions@freebsd.org > > Cc: > > Date: Thu, 2 Oct 2014 11:52:06 +0200 > > Subject: Listen queue overflow: 8 already in queue awaiting acceptance > > Hello, > > > > I'm running 10-RELEASE on a HP Proliant DL160 Gen8 and I'm seeing the > > following in my kernel logs: > > sonewconn: pcb 0xfffff8010e561310: Listen queue overflow: 8 already in > > queue awaiting acceptance >=20 > This usually means the application is not keeping up with the incoming > connections. > > > > I already raised kern.ipc.soacceptqueue to 1024 and netstat -naA | grep > > "fffff8010e561310" returns nothing >=20 > This is the usual way of finding the culprit process. If this doesn't > return anything, it probably means that it is a short-lived process. >=20 > Here is an example of what you could do: >=20 > sonewconn: pcb 0xfffff8008f40cb10: Listen queue overflow: 1 already in qu= eue > awaiting acceptance >=20 > From kgdb, > (kgdb) p ((struct inpcb *)0xfffff8008f40cb10)->inp_inc > $3 =3D {inc_flags =3D 0 '\0', inc_len =3D 0 '\0', inc_fibnum =3D 0, inc_i= e =3D {ie_fport > =3D 0, ie_lport =3D 10295, ie_dependfaddr =3D { > ie46_foreign =3D {ia46_pad32 =3D {0, 0, 0}, ia46_addr4 =3D {s_addr = =3D 0}}, > ie6_foreign =3D {__u6_addr =3D { > __u6_addr8 =3D '\0' <repeats 15 times>, __u6_addr16 =3D {0, 0, = 0, 0, 0, > 0, 0, 0}, __u6_addr32 =3D {0, 0, 0, 0}}}}, > ie_dependladdr =3D {ie46_local =3D {ia46_pad32 =3D {0, 0, 0}, ia46_ad= dr4 =3D > {s_addr =3D 0}}, ie6_local =3D {__u6_addr =3D { > __u6_addr8 =3D '\0' <repeats 15 times>, __u6_addr16 =3D {0, 0, = 0, 0, 0, > 0, 0, 0}, __u6_addr32 =3D {0, 0, 0, 0}}}}}} >=20 > Here, ie_lport =3D 10295 which is in n/w byte order and converting it to = host > byte order, 10295 -> 0x2837 and swapping them gives us 0x3728 which is 14= 120. >=20 > Now, use sockstat to find out what process is on that port: >=20 > $ sockstat -l | grep 14120 >=20 > cheers, > Hiren --=20 Julien Cigar Belgian Biodiversity Platform (http://www.biodiversity.be) PGP fingerprint: EEF9 F697 4B68 D275 7B11 6A25 B2BB 3710 A204 23C0 No trees were killed in the creation of this message. However, many electrons were terribly inconvenienced. --MqkwUViToTQK+HjE Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v2 iQIcBAABCgAGBQJULZdOAAoJEAi2KiTKQR5ppMsQAMoXy4Cp/wtNLhg6eB69f6Pc tt8x0f5rHZOzusOZbcwrejzmviE18bMJV9TaVeAlKXcAKHYuE5SzbnDfI9BZbXJh 42IVHjhRohQR8i8jYSuYCHd8d6t5KT417/ArhxrcKGcWgllReNS4rNYa3S0dROS0 MT8HWc/Aw1Vj0p0cfr4GtdmdNW+bE5OZZ/ohPElsJ3Q2NpWBDVB3VtcuayYXuog1 fYXh8A2MRQFsPT0vU2rgjI3HsyhfwDQJ8i0KR5whz0EqfACgNMn6kJO3z3qI85zl DvHVJpidrlZ19p7+2W0tU3E7fzuE+o1oQ4P7WAMzn3QBibLSuF5ruVsJCt1JXBZB yuvBaycMDlN3C2za51KsMUdQZGP6El2zhfE1kIlda7RoidLfii49ndyBiRN8eZ3S IzWxWGjIjJuYeZGfnT5PrU7p3MscYkf9l0o6Qn8nYZZG4PefK2xo0xzkkIfmKhJB hF144vMY7PVlcblXlaV+kBHVSfPeXUkkICvaEMMB1pfV13Z3I6ns9Jhzg+fnWrMA LSeM/6eH9HtxuF6fk1GVD3R3EbsQG58c+zN+2S0gyEjDzjgxj/ZTUB1AUZ68a/TQ 82+i7CfePx6bcm9urFZ7lqf9uVGl9wx7NzfPkP8ThpdsS7WQ/qrAMhZ1InxjWv6j AAQ/n0t+UpH2fKFInP+r =xvC2 -----END PGP SIGNATURE----- --MqkwUViToTQK+HjE--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20141002181958.GJ29361>