From nobody Sun Oct 3 22:18:38 2021 X-Original-To: freebsd-net@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 91A2F17D7258; Sun, 3 Oct 2021 22:18:44 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4HMytD3l3gz4hsX; Sun, 3 Oct 2021 22:18:44 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from onlyone.not-for.work (onlyone.not-for.work [IPv6:2a01:4f8:201:6350::2]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) (Authenticated sender: lev/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id 47179DC0E; Sun, 3 Oct 2021 22:18:44 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from [IPv6:2001:470:923f:1:6156:2424:3ec4:471e] (unknown [IPv6:2001:470:923f:1:6156:2424:3ec4:471e]) (Authenticated sender: lev@serebryakov.spb.ru) by onlyone.not-for.work (Postfix) with ESMTPSA id A6B6F13442; Mon, 4 Oct 2021 01:18:39 +0300 (MSK) To: freebsd-net@freebsd.org, freebsd-stable Reply-To: lev@FreeBSD.org From: Lev Serebryakov Subject: TCP-related sysctls from year-old 12-STABLE renders fresh 12-STABLE inaccessible Organization: FreeBSD Message-ID: Date: Mon, 4 Oct 2021 01:18:38 +0300 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:78.0) Gecko/20100101 Thunderbird/78.14.0 List-Id: Networking and TCP/IP with FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-net List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-net@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-ThisMailContainsUnwantedMimeParts: N I've upgraded year-old 12.2-STABLE (12.2-STABLE 1202504) to very fresh (stable/12-n233937-a17cf1bed9d) and after reboot server has not been able to start all network daemons. I have this `/etc/sysctl.conf` which gives me much better performance on 10G links: net.inet.tcp.recvbuf_auto=1 net.inet.tcp.recvbuf_inc=131072 net.inet.tcp.recvbuf_max=16777216 net.inet.tcp.recvspace=16777216 net.inet.tcp.sendbuf_auto=1 net.inet.tcp.sendbuf_inc=131072 net.inet.tcp.sendbuf_max=16777216 net.inet.tcp.sendspace=16777216 net.inet.tcp.maxtcptw=102400 net.inet.tcp.mssdflt=8800 kern.ipc.maxsockbuf=16777216 kern.ipc.somaxconn=8192 When these sysctls are applied, network services fail to start with different diagnostics. For example, sshd complains that it can not bind to any address. Bisecting this file, I found that these lines is the cause: net.inet.tcp.recvspace=16777216 net.inet.tcp.sendspace=16777216 Removing them allows services to start. But now my 10G performance is not the best again. What happens to these sysctls? What is recommended values for 10G links now? -- // Lev Serebryakov