Date: Fri, 27 Jun 2025 10:17:18 +0800 From: Ben Hutton <ben@benhutton.com.au> To: freebsd-net@freebsd.org Subject: Network Tuning - mbuf Message-ID: <8255b0b9-c9df-4af9-bbb2-94140edf189c@benhutton.com.au>
next in thread | raw e-mail | index | archive | help
[-- Attachment #1 --]
Hi,
I'm currently having an issue with a spring-boot application (with
nginx in front on the same instance) running on FreeBSD 14.1 in AWS.
Two of our instances at present have had the application go offline with
the following appearing in the /var/log/messages:
Jun 26 07:57:47 freebsd kernel: [zone: mbuf_jumbo_page]
kern.ipc.nmbjumbop limit reached
Jun 26 07:57:47 freebsd kernel: [zone: mbuf_cluster]
kern.ipc.nmbclusters limit reached
Jun 26 07:59:34 freebsd kernel: sonewconn: pcb 0xfffff8021bd74000
(0.0.0.0:443 (proto 6)): Listen queue overflow: 193 already in queue
awaiting acceptance (104 occurrences), euid 0, rgid 0, jail 0
Jun 26 08:01:51 freebsd kernel: sonewconn: pcb 0xfffff8021bd74000
(0.0.0.0:443 (proto 6)): Listen queue overflow: 193 already in queue
awaiting acceptance (13 occurrences), euid 0, rgid 0, jail 0
Each time this has occurred I have increased the nmbjumbop and
nmbclusters values. The last time by a huge amount to see if we can
mitigate the issue. Once I adjust the values the application starts
responding to requests again.
My question is, is just increasing this the correct course of action or
should I be investigating something else, or adjusting other settings
accordingly? Also if this is due to an underlying issue and not just
network load how would I get to the root cause? Note the application
streams allot of files in rapid succession which I'm suspecting is what
is causing the issue.
Thanks
Ben
[-- Attachment #2 --]
<!DOCTYPE html>
<html>
<head>
<meta http-equiv="content-type" content="text/html; charset=UTF-8">
</head>
<body>
<div class="moz-text-html" lang="x-unicode">
<p>Hi,</p>
<p>I'm currently having an issue with a spring-boot application
(with nginx in front on the same instance) running on FreeBSD
14.1 in AWS. Two of our instances at present have had the
application go offline with the following appearing in the
/var/log/messages:</p>
<p> <span style="font-family:monospace"><span
style="color:#000000;background-color:#ffffff;">Jun 26
07:57:47 freebsd kernel: [zone: mbuf_jumbo_page]
kern.ipc.nmbjumbop limit reached</span><span
style="color:#000000;background-color:#ffffff;"> </span><br>
<span style="color:#000000;background-color:#ffffff;">Jun 26
07:57:47 freebsd kernel: [zone: mbuf_cluster]
kern.ipc.nmbclusters limit reached</span><span
style="color:#000000;background-color:#ffffff;"> </span><br>
<span style="color:#000000;background-color:#ffffff;">Jun 26
07:59:34 freebsd kernel: sonewconn: pcb 0xfffff8021bd74000
(0.0.0.0:443 (proto 6)): Listen queue overflow: 193 already
in queue awaiting acceptance (104 occurrences), euid 0, rgid
0, jail 0</span><span
style="color:#000000;background-color:#ffffff;"> </span><br>
<span style="color:#000000;background-color:#ffffff;">Jun 26
08:01:51 freebsd kernel: sonewconn: pcb 0xfffff8021bd74000
(0.0.0.0:443 (proto 6)): Listen queue overflow: 193 already
in queue awaiting acceptance (13 occurrences), euid 0, rgid
0, jail 0</span><br>
<span style="color:#000000;background-color:#ffffff;"> </span><br>
</span>Each time this has occurred I have increased the
nmbjumbop and nmbclusters values. The last time by a huge amount
to see if we can mitigate the issue. Once I adjust the values
the application starts responding to requests again.</p>
<p>My question is, is just increasing this the correct course of
action or should I be investigating something else, or adjusting
other settings accordingly? Also if this is due to an underlying
issue and not just network load how would I get to the root
cause? Note the application streams allot of files in rapid
succession which I'm suspecting is what is causing the issue.</p>
<p>Thanks<br>
Ben</p>
</div>
<p><br>
</p>
</body>
</html>
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?8255b0b9-c9df-4af9-bbb2-94140edf189c>