From owner-freebsd-net@freebsd.org Wed Dec 30 16:08:06 2020 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id DFC054C77B3 for ; Wed, 30 Dec 2020 16:08:06 +0000 (UTC) (envelope-from vit@otcnet.ru) Received: from mail.otcnet.ru (mail.otcnet.ru [194.190.78.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4D5bmQ0189z3qGG for ; Wed, 30 Dec 2020 16:08:05 +0000 (UTC) (envelope-from vit@otcnet.ru) Received: from MacBook-Gamov.rinet.ru (unknown [195.91.218.161]) by mail.otcnet.ru (Postfix) with ESMTPSA id F3163E0EA7; Wed, 30 Dec 2020 19:08:03 +0300 (MSK) From: Victor Gamov Subject: Re: 'dropped due to full socket buffers' by SNMP To: Eugene Grosbein , freebsd-net@freebsd.org References: <388da9a7-7b89-89b2-54eb-17d0e818c924@otcnet.ru> <4e41c1d2-19bc-0345-0b03-526e4cb785c7@otcnet.ru> <6c780827-e764-8053-356b-a921e0892c15@grosbein.net> Organization: OstankinoTelecom Message-ID: Date: Wed, 30 Dec 2020 19:08:03 +0300 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.13; rv:78.0) Gecko/20100101 Thunderbird/78.6.0 MIME-Version: 1.0 In-Reply-To: <6c780827-e764-8053-356b-a921e0892c15@grosbein.net> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4D5bmQ0189z3qGG X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of vit@otcnet.ru designates 194.190.78.3 as permitted sender) smtp.mailfrom=vit@otcnet.ru X-Spamd-Result: default: False [-1.20 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+a:mail.otcnet.ru]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[otcnet.ru]; RBL_DBL_DONT_QUERY_IPS(0.00)[194.190.78.3:from]; NEURAL_SPAM_SHORT(1.00)[1.000]; HAS_ORG_HEADER(0.00)[]; SPAMHAUS_ZRD(0.00)[194.190.78.3:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_COUNT_TWO(0.00)[2]; ASN(0.00)[asn:50822, ipnet:194.190.78.0/24, country:RU]; MAILMAN_DEST(0.00)[freebsd-net] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 30 Dec 2020 16:08:06 -0000 On 30/12/2020 12:57, Eugene Grosbein wrote: > 30.12.2020 16:44, Victor Gamov wrote: > >> Currently I'm thinking about ethernet flow control: Host-B connected to VLAN-750 on the third switch has 1G link (via igb driver) >> and both Host-A and Host-B has fc=3. So when Host-B get microburst it can send PAUSE and Host-A start to fill queue. >> But FC disabled for all switches and I'm not sure about PAUSE can be propagated from Host-A to Host-B > > AFAIK, pause frames are not forwarded. For short term you should make flow control settings consistent > between link partners, As I understand hw.ix.flow_control=3 to allow flow-control for negotiation. Real PAUSE setting will be set during negotiation. So where I can find active flow-control setting for host interface? > maybe increase kern.ipc.maxsockbuf and then net.inet.udp.recvspace. Eugene, at first message you suppose Host-A (sender) "outgoing link for that UDP packets is congested" because this host shows non-zero "dropped due to full socket buffers". So is net.inet.udp.recvspace increasing on Host-B (mainly receiver) will be affected for this congestion? Or I need to try to increase both kern.ipc.maxsockbuf and net.inet.udp.recvspace on both hosts? Also how I can check current sockbuf usage? > But for long term you should consider adding more links and create LACP aggregate > so not input nor output link be close to congestion. I'll migrate to 10G on Host-B at next month. Thanks for your advise! -- CU, Victor Gamov