From owner-freebsd-net@freebsd.org Fri May 12 20:55:19 2017 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id EF36AD6A5F6; Fri, 12 May 2017 20:55:19 +0000 (UTC) (envelope-from karl@denninger.net) Received: from mail.denninger.net (denninger.net [70.169.168.7]) by mx1.freebsd.org (Postfix) with ESMTP id A902110B5; Fri, 12 May 2017 20:55:19 +0000 (UTC) (envelope-from karl@denninger.net) Received: from [192.168.10.40] (Karl-Desktop.Denninger.net [192.168.10.40]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by mail.denninger.net (Postfix) with ESMTPSA id 2D10839AB; Fri, 12 May 2017 15:55:18 -0500 (CDT) From: Karl Denninger Subject: Re: Possible -HEAD problem with the Pi3 onboard ethernet To: freebsd-arm@freebsd.org, freebsd-net@freebsd.org References: Message-ID: Date: Fri, 12 May 2017 15:55:17 -0500 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:52.0) Gecko/20100101 Thunderbird/52.1.0 MIME-Version: 1.0 In-Reply-To: Content-Type: multipart/signed; protocol="application/pkcs7-signature"; micalg=sha-512; boundary="------------ms060801010608080500020002" X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 12 May 2017 20:55:20 -0000 This is a cryptographically signed message in MIME format. --------------ms060801010608080500020002 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Update: This MAY be caused by net.inet.tcp.rfc6675_pipe=3D1, which I had recently enabled since I am now moving data over WAN-style distances on a regular basis and since both ends are FreeBSD with this capability I figured it might help performance. If so it almost-certainly isn't ARM-specific...... I shut that off (it was recently turned on) and thus far I'm not able to recreate the network hangs.... Hmmmm... CCing into freebsd-net, as this is looking increasingly like a non-ARM-specific thing. Feel free to remove freebsd-arm from responses (in fact, probably ought to unless someone can confirm it's working properly on other architectures but not on ARM.) On 5/12/2017 12:45, Karl Denninger wrote: > Under fairly heavy stress (~50% of the 100Mbps possible FDX performance= ) > I've now run into a problem that is turning into something I can repeat= > without too much trouble by transmitting a large file through the devic= e. > > The system appears to "crash" from the outside. It's not dead, however= > -- it's got some sort of network buffer hang going on. This is a Pi3 > with current (-HEAD, FreeBSD 12.0-CURRENT #0 r318193M: Thu May 11 > 16:18:20 CDT 2017) software on it -- reverting to a mid-March kernel di= d > NOT change the behavior. > > The symptomology is that the unit will start printing this on the conso= le: > > May 12 12:25:46 IPGw dhcpd: send_packet: No buffer space available > May 12 12:25:46 IPGw dhcpd: dhcp.c:3974: Failed to send 300 byte long > packet over ue0.3 interface. > > ue0.3 is a VLAN for a private subnet and is not specific to the issue; > it also complains about no space on the primary too: > > May 12 12:27:06 IPGw dhcpd: dhcp.c:3974: Failed to send 300 byte long > packet over ue0 interface. > May 12 12:27:13 IPGw dhcpd: send_packet: No buffer space available > > netstat -m does /not /show any denied or delayed requests for network > buffers or mbuf exhaustion. Systat -vm shows plenty of RAM available > (roughly half.) > > An ifconfig ue0 down / ifconfig ue0 up sequence from the console clears= > the hang. > > Has anyone else seen anything similar to this? > --=20 Karl Denninger karl@denninger.net /The Market Ticker/ /[S/MIME encrypted email preferred]/ --------------ms060801010608080500020002 Content-Type: application/pkcs7-signature; name="smime.p7s" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="smime.p7s" Content-Description: S/MIME Cryptographic Signature MIAGCSqGSIb3DQEHAqCAMIACAQExDzANBglghkgBZQMEAgMFADCABgkqhkiG9w0BBwEAAKCC BlwwggZYMIIEQKADAgECAgE9MA0GCSqGSIb3DQEBCwUAMIGQMQswCQYDVQQGEwJVUzEQMA4G A1UECBMHRmxvcmlkYTESMBAGA1UEBxMJTmljZXZpbGxlMRkwFwYDVQQKExBDdWRhIFN5c3Rl bXMgTExDMRwwGgYDVQQDExNDdWRhIFN5c3RlbXMgTExDIENBMSIwIAYJKoZIhvcNAQkBFhND dWRhIFN5c3RlbXMgTExDIENBMB4XDTE2MTIxODE5NDUzNVoXDTIxMTIxNzE5NDUzNVowVzEL MAkGA1UEBhMCVVMxEDAOBgNVBAgTB0Zsb3JpZGExGTAXBgNVBAoTEEN1ZGEgU3lzdGVtcyBM TEMxGzAZBgNVBAMUEmthcmxAZGVubmluZ2VyLm5ldDCCAiIwDQYJKoZIhvcNAQEBBQADggIP ADCCAgoCggIBAM2N5maxs7NkoY9g5NMxFWll0TYiO7gXrGZTo3q25ZJgNdPMwrntLz/5ewE9 07TEbwJ3ah/Ep9BfZm7JF9vTtE1HkgKtXNKi0pawNGm1Yn26Dz5AbUr1byby6dFtDJr14E07 trzDCtRRvTkOVSBj6PQPal0fAnDtkIYQBVcuMkXkuMCtyfE95pjm8g4K9l7lAcKii3T1/3rE hCc1o2nBnb7EN1/XwBeCDGB+I2SN/ftZDbKQqGAF5q9dUn+iXU7Z/CVSfUWmhVh6cVZA4Ftv TglUqj410OuPx+cUQch3h1kFgsuhQR63HiJc3HbRJllHsV0rihvL1CjeARQkhnA6uY9NLFST p5I/PfzBzW2MSmtN/tGZvmfKKnmtbfUNgkzbIR1K3lsum+yEL71kB93Xtz/4f1demEx5c8TJ RBIniDHjDeLGK1aoBu8nfnvXAvgthFNTWBOEoR49AHEPjC3kZj0l8JQml1Y8bTQD5gtC5txl klO60WV0EufU7Hy9CmynMuFtjiA2v71pm097rXeCdrAKgisdYeEESB+SFrlY65rLiLv4n8o1 PX7DqRfqKkOYIakZ0ug/yHVKcq2EM3RiJxwzls5gT70CoOBlKbrC98O8TA6teON0Jq30M06t NTI2HhvNbJDLbBH+Awf4h1UKB+0ufENwjVvF5Jfz8Ww/FaSDAgMBAAGjgfQwgfEwNwYIKwYB BQUHAQEEKzApMCcGCCsGAQUFBzABhhtodHRwOi8vY3VkYXN5c3RlbXMubmV0Ojg4ODgwCQYD VR0TBAIwADARBglghkgBhvhCAQEEBAMCBaAwCwYDVR0PBAQDAgXgMCwGCWCGSAGG+EIBDQQf Fh1PcGVuU1NMIEdlbmVyYXRlZCBDZXJ0aWZpY2F0ZTAdBgNVHQ4EFgQUpfAI3y+751pp9A0w 6vJHx8RoR/MwHwYDVR0jBBgwFoAUJHGbnYV9/N3dvbDKkpQDofrTbTUwHQYDVR0RBBYwFIES a2FybEBkZW5uaW5nZXIubmV0MA0GCSqGSIb3DQEBCwUAA4ICAQBiB6MlugxYJdccD8boZ/u8 d8VxmLkJCtbfyYHRjYdyoABLW5hE3k3xSpYCM9L7vzWyV/UWwDYKi4ZzxHo4g+jG/GQZfKhx v38BQjL2G9xD0Hn2d+cygOq3UPjVYlbbfQoew6JbyCFXrrZ7/0jvRMLAN2+bRC7ynaFUixPH Whnj9JSH7ieYdzak8KN+G2coIC2t2iyfXVKehzi5gdNQ0vJ7+ypbGsRm4gE8Mdo9N/WgFPvZ HPFqR9Dwas7Z+aHwOabpk5r/336SyjOaZsn3MqKJQZL6GqDKusVOCWt+9uFAD8kadg7FetZe atIoD9I+zbp59oVoMnkMDMx7Hi85faU03csusqMGsjSsAzWSI1N8PJytZlchLiykokLKc3OL G87QKlErotlou7cfPX2BbEAH5wmkj9oiqZhxIL/wwAUA+PkiTbEmksKBNompSjUq/6UsR8EA s74gnu17lmijv8mrg2qMlwRirE7qG8pnE8egLtCDxcjd0Of9WMi2NJskn0/ovC7P+J60Napl m3ZIgPJst1piYSE0Zc1FIat4fFphMfK5v4iLblo1tFSlkdx1UNDGdg/U+LaXkNVXlMp8fyPm R80V6cIrCAlEWnBJNxG1UyfbbsvNMCCZBM4faGGsR/hhQOiydlruxhjL6P8J2WV8p11DdeGx KymWoil2s1J5WTGCBRMwggUPAgEBMIGWMIGQMQswCQYDVQQGEwJVUzEQMA4GA1UECBMHRmxv cmlkYTESMBAGA1UEBxMJTmljZXZpbGxlMRkwFwYDVQQKExBDdWRhIFN5c3RlbXMgTExDMRww GgYDVQQDExNDdWRhIFN5c3RlbXMgTExDIENBMSIwIAYJKoZIhvcNAQkBFhNDdWRhIFN5c3Rl bXMgTExDIENBAgE9MA0GCWCGSAFlAwQCAwUAoIICTTAYBgkqhkiG9w0BCQMxCwYJKoZIhvcN AQcBMBwGCSqGSIb3DQEJBTEPFw0xNzA1MTIyMDU1MTdaME8GCSqGSIb3DQEJBDFCBEB4+LyX +vxtI/d3YaGSxcDauco95qq7i8orVtP1W276Mt4o1rCJDtltX5LWjmuZEuepZnz8y6jqJVpW y7RqEqLwMGwGCSqGSIb3DQEJDzFfMF0wCwYJYIZIAWUDBAEqMAsGCWCGSAFlAwQBAjAKBggq hkiG9w0DBzAOBggqhkiG9w0DAgICAIAwDQYIKoZIhvcNAwICAUAwBwYFKw4DAgcwDQYIKoZI hvcNAwICASgwgacGCSsGAQQBgjcQBDGBmTCBljCBkDELMAkGA1UEBhMCVVMxEDAOBgNVBAgT B0Zsb3JpZGExEjAQBgNVBAcTCU5pY2V2aWxsZTEZMBcGA1UEChMQQ3VkYSBTeXN0ZW1zIExM QzEcMBoGA1UEAxMTQ3VkYSBTeXN0ZW1zIExMQyBDQTEiMCAGCSqGSIb3DQEJARYTQ3VkYSBT eXN0ZW1zIExMQyBDQQIBPTCBqQYLKoZIhvcNAQkQAgsxgZmggZYwgZAxCzAJBgNVBAYTAlVT MRAwDgYDVQQIEwdGbG9yaWRhMRIwEAYDVQQHEwlOaWNldmlsbGUxGTAXBgNVBAoTEEN1ZGEg U3lzdGVtcyBMTEMxHDAaBgNVBAMTE0N1ZGEgU3lzdGVtcyBMTEMgQ0ExIjAgBgkqhkiG9w0B CQEWE0N1ZGEgU3lzdGVtcyBMTEMgQ0ECAT0wDQYJKoZIhvcNAQEBBQAEggIAgYtoMKC/ZT0I VN2H65PkG/ds3QOLyGOpEQe8HIZOpi0eTMMHi41YtxhepgGvx/os8Xg8L15/IhG2nQVx69AK 3n+MP1f8MqdDAZKSf3ibQAO2C3FRbEPL9qo01VoIU+TOdQz31dlPnZ7o+bY3W3eCtrf5aQ9I ochAGYhdOmdrK4dsRd7mPtch5bgDlpFN5VNZXyt+4dd00tArOcRRqygcpSd+3AlN30ku7XCI yFmGOClG3+XnrKwjdXhk5BGWMhEprN+uRNPiSjPecDuOXhZBsngh4/lilPPtKvZz1P5bWIzD YD4KajCmUpdoSiXYVR2+RBLA/nTLOOlbO8pBxhzg+fE3nba8bEwoejQLYbzxdQ2SGQU7YAKU SdKcgICo4HWYjF0MNNtmWI+TnQjLiDwVNfI9Xay6WSXJkYLC6R+BuZGcL8Kkh/drvldt8AVs H1hOtcnsECCw5Zmk3mfjOFITHtAk0U3ATjhVExKA1se0oNqnzYLU89v/D/JT4zELUouORh47 Kkz2V/s4+ylJdwnLOa37WsAbqngdbzOi2Zva+kvFlTlz3chUql2YfMMVxkwXIdSEWKh0UPXB SbgKwQyPfSGANxnU2LL5KQPo7gE0nEGJoA83AjImOLAXKFlm7uR8oyzMqvVKidrBGBwqV2DN P2dGZf/0Fi8Ku/f09bwPTc0AAAAAAAA= --------------ms060801010608080500020002--