From owner-freebsd-stable@freebsd.org Tue May 22 13:53:23 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D5C9CEF6B5F for ; Tue, 22 May 2018 13:53:22 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from onlyone.not-for.work (onlyone.not-for.work [IPv6:2a01:4f8:201:6350::2]) by mx1.freebsd.org (Postfix) with ESMTP id 3F8A775BD8 for ; Tue, 22 May 2018 13:53:22 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from [192.168.23.186] (unknown [89.113.128.32]) (Authenticated sender: lev@serebryakov.spb.ru) by onlyone.not-for.work (Postfix) with ESMTPSA id 628735E for ; Tue, 22 May 2018 16:53:21 +0300 (MSK) To: freebsd-stable@freebsd.org Reply-To: lev@FreeBSD.org From: Lev Serebryakov Subject: =?UTF-8?Q?11-STABLE_still_livelocks_under_combined_network_&_disk_a?= =?UTF-8?Q?ctivity_=e2=80=94_patch_from_D7538_helps?= Openpgp: preference=signencrypt Autocrypt: addr=lev@FreeBSD.org; prefer-encrypt=mutual; keydata= xsFNBFKbGksBEADeguVs+XyJc3mL3iiOBqDd16wSk97YTJYOi4VsHsINzJr09oFvNDiaDBIi fLn2p8XcJvehcsF2GSgrfXfw+uK4O1jyNIKJmiYA0EtE+ZbRtvDrrE0w6Q8+SDeKA21SWh3Y vSQ0DJUontbgW55ER2CbEiIUTIn34uQ0kmESAaw/v5p/9ue8yPTmURvv130FqPFz8VPzltqL NxyGt54TxPfKAzAHEIwxlEZ63JOwzloKh1UDBExcsf9nJO08/TAVgR5UZ5njFBPzaaquhRoP qPJLEQQDqxPIlvMNtHKf7iIebE4BHeqgCdJA0BoiR6gpa0wlsZtdrTPK3n4wYSphLvGbhfOZ YW/hbcu7HYS/FImkVxB3iY17kcC1UTnx4ZaYeASPBGOOPbXky1lLfmDGWIFT//70yx+G17qD OZzF1SvJJhGvh6ilFYaWMX7T+nIp6Mcafc4D7AakXM+XdubNXOMlCJhzPcZ0skgAEnYV587w V7em5fDVwQccwvtfezzqKeJAU5TGiywBHSR5Svzk2FwRNf6M//hWkpq0SRR63iOhkHGOAEBi 69GfEIwH2/w24rLxP0E+Hqq8n+EWNkPatw1Mhcl5PKkdvGCjJUaGNMkpBffjyYo254JXRscR eEnwdIkJt4ErDvjb2/UrOFq31wWMOiLzJeVchAgvTHBMRfP9aQARAQABzShMZXYgU2VyZWJy eWFrb3YgPGxldkBzZXJlYnJ5YWtvdi5zcGIucnU+wsGCBBMBCAAsAhsDBwsJCAcDAgEGFQgC CQoLBBYCAwECHgECF4ACGQEFAlKbP8wFCQlmJwEACgkQ6rA8WL/cR4/6VBAAjRMyyX3PBFx/ HxyiIZ698EfwlWUua8Ft4crtrdK52m0qNkbBB9BH8xQgBHG32A1CwyzQnzxHgZuoOWMjh+Qq WJv7dmpM/q/c1GCJHhlPgewXrciTwpAamZILN071u+1GCPWwGRPzfQ/U+k63KJWx9ozf4doM WTTom6Cqcssi4J1u5kkt52a5ZRhsCK9pEVGilk36XTP9BakGrnMSIxF/NK4xeZVX2q+Nuqvf RchyofKXVgLEDLwb1cd/baLtBpDzy0PTN2Zl2lX4kOA6jwTKsqRya9A1Vui1KXwPh2XViTQ1 7Y3l5qg/M+sR73DohezP6bO6huOnLhty17jAqHPNlD6RonDo+j8uIlEg4iMSTN3MhzkBAu0Q pe3ucQ0o1767JiXN3fsNvRzSFhLVNDqPLce4uKlMogsbreXWvdgHGTN1ybOHGbybZnP77yHz uNBacbmG3vL/OLXMqwLdL2JXoiec4DmXjjCdhTBl5xLV9Hz/6VWKqElteg8QFVvHB3tHWzJ4 /rpiVEixytCIII6DS33BXZ0h2EOkK/6AYA2SJxy1vgOH4SZBtDBHoezmHV2nFnq5O0c7AuAB 7WPWgQG0sEwHQPZmg/baRGitRJnaxf/Gvf1DeD1x1VrcoVke2vwBcgDM3kugP8L9hsqic2D3 dI+gP76haeuvNNZr3y9L9zvOwU0EUpsaSwEQALRr3B+OjY/cnJPstz5CVsVWyEZtJtrNviZr tBgbkhlkPm98sEWR4+gbpyeufdYJengDjeGzMDKcLB7h5fICS/j6A8XdlJ40TlbPfNgb6OHa ebaIYKTJpXKR9sD7ZyGivYMofm0em40wGUX7BIkdkomaWj+wUiS0CdXU0FWDj9wv73+Eim+X zZyXeFgIPv97v+pET7DfwKkADOfrkW9s4OfvGVjd+wm35wc8EngQEz0qdPBxx74X7vZFAxlA SXu8gDBJGYt2Bkc3QwULnfeXrZJWgqNPR5o44gGu96yaiOFaN/C6CJtev5ZEX+0ZxbvsHHB7 Z5AtsRURKpZ4w5HFHGhzHtDtoAKgeZ/gbhTVXPHvNQR818eN+Nl5BV8BRF/8yhR6VlJb8GYw h8oKDeVGVYC34+raHZQAM9WoBnN7jlt4T9zzPwtmw5mIahGFgvw1KDr7OItN2ZgtZ20UYC5m Go602nmHq0aPbU6SwGi1xohrliNsKaaciYiMaVIGRQq8iGr9Fe2HlvaA3BpB275i/gCVlUdG y5XLAv+yQMUvn5Z7XVsMroxDk/O+ae1ElyBvKiKyfWGJXTg5XUukkkyQmfWPxWUGoNA1P/P4 GMHSu7/Rqe/7m4uPu/RyTTqsSjjKJdP9kBwEzvqPtXsVoZuShtrptRQJDYflhgE4qmKSMKen ABEBAAHCwWUEGAECAA8FAlKbGksCGwwFCRLMAwAACgkQ6rA8WL/cR48RkA//SNzeW3CI8KHx rA0aeHW6Nb5ieoqVRBGLyjBM06RX6vHB9v4dJL6Z+yV2jGN2s+XZX2HILbuTOwcTxGkI3xTT e0cDXVaF5K8R/liigUjtwuC2v/sWgoWyUmK1Cy9CPYdcXmFq6nESfkUe8DYiGOUULdHq5w63 F53yOZ72iXRBQBZgkhPtRFu4lPYIzOsMag9DIJ9CthR1r0ziqU/keb94Qt3l+aXK7CwGdY7X T4zUIMHNYsuAuyX+NJIXfsN68TT6m7QmlUwxPs13nxmoVQzm4ruV+hlQKh1MtbsjWRkNgPxF IPiqoAEhy8QoddlSvRTwL5Z7zFQiwMdiXU7toL8pfzj/zJR1jELXKMipijrt5MLrV8XX3OPN yZZvh95VIl8mv+iAqwSZUufd2EJnvj5TObB0eH+a+34NWf/XqA3fPjE6KHzmdnw9PZjPEjlx JCPECSs+6gse1+GaEfKYuXzB/ENe2ctlcfx5iQJXFc+/+zG/uU/JX/pXJHA12CUfB5g7lH6X BZIHvRo3VTCDjXgbF5xxDAe5V4exf8d4oSNjQIFLYxxN7zkvH89EN6RPfRgsWN7bYArCwfS9 MOgs9pFeCOewR6qieK150aoqNENGfKFXJup+5VVl6I0mU+j0rgVDZDht2/QgP/Tb4lGBe+ai pOGaK/GYNR+Ad6bUmokKsx4= Organization: FreeBSD Message-ID: Date: Tue, 22 May 2018 16:53:20 +0300 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:52.0) Gecko/20100101 Thunderbird/52.7.0 MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="lmV8o2KfPLHJV1SQIRHVEWninIHlm0SsZ" X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.26 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 22 May 2018 13:53:23 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --lmV8o2KfPLHJV1SQIRHVEWninIHlm0SsZ Content-Type: multipart/mixed; boundary="KAQoNDMBKdr384oUdAEnIXhlNTSK3uv2S"; protected-headers="v1" From: Lev Serebryakov Reply-To: lev@FreeBSD.org To: freebsd-stable@freebsd.org Message-ID: Subject: =?UTF-8?Q?11-STABLE_still_livelocks_under_combined_network_&_disk_a?= =?UTF-8?Q?ctivity_=e2=80=94_patch_from_D7538_helps?= --KAQoNDMBKdr384oUdAEnIXhlNTSK3uv2S Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: quoted-printable My home server (and torrent box) is rather beefy (E3-1220v3, 16GiB RAM, radiz5, SSD L2ARC), NIC is igb (I210). This server expieince live-lock when there is fast and large download with multiple streams (some very popular large torrent). In this state it is not accessible by SSH, USB is failed (UPS, mouse and keyboard are flaky), existing ssh connection is not simply "slow" but almost unusable: 1-2 keypresses PER MINUTE, etc. top(1) shows (with 1 "frame" per minute update) that 100% of CPU is consumed by "intr{irqXXX: igb0:que X}" in this state, memory is really low (less than 100MiB) and pmc-based stats shows, that it is very hard lock congestion somewhere in memory subsystem. As soon as download is finished, everything become normal again. Please note, that it is 100Mb/s download at max, not 1Gb/s! I've tried to tune different sysctls and even tuned UDP buckets, but it doesn't help. This problem could be solved by https://reviews.freebsd.org/D7538. Maybe, it could be integrated to system? Or there are other solutions? --=20 // Lev Serebryakov --KAQoNDMBKdr384oUdAEnIXhlNTSK3uv2S-- --lmV8o2KfPLHJV1SQIRHVEWninIHlm0SsZ Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- iQKTBAEBCgB9FiEE+W0coLX0MYtnSzMK6rA8WL/cR48FAlsEINBfFIAAAAAALgAo aXNzdWVyLWZwckBub3RhdGlvbnMub3BlbnBncC5maWZ0aGhvcnNlbWFuLm5ldEY5 NkQxQ0EwQjVGNDMxOEI2NzRCMzMwQUVBQjAzQzU4QkZEQzQ3OEYACgkQ6rA8WL/c R4+cSw/+N+jZw5QY7z62g83/Zz30ronsWGycNLB/QPa9baFw/u+wuiEWD4tQfBcp xlgSQopqyW3ZGUIpH01mASBAOk+bZT3idd+lgyRXerFQSxf8rzZH13CtwhbciuZq fqFgwY/K8/sM0YFd9EEt06sDuBoFaAfJUG6AVt/78poKhWlEFHJTk+3mPl+MTiww bNyJyIVAfbzLISMLOKYESNoNA9P//w7KKBmco3xHvYNYTjTcYyVy/bZA7FON2B67 oXtFoObwtEKF9JpzNRmR5OE5j11omsFMO9pnNw3jSl4Gwu2TAT8snInvWSuIv7+w y7pIxReO+0j7VJj7R/NEMuTXdPjAf77WQe1MhbqFswEc5gQVd3U35GNCJ27HdDvs 6mIphCwa9yL8ayj20TZ/0T/VCyutJhAY92+0E+RJ/gfOk66oWMyD2qcxkLmkkOpA qBJO1guUd9x5+JaJXzBBBrfRdL0Ld2sNnOr1wMpNpyX0SxVJoHWOTySH/oqCQtAc LmTbgGGwsjj53tIodSNS87n8fRX65cET3i+o3yn5/aoZ2UIbS8C0lzPifn11XnfO 3R7o41wv9ikZGdp7VNwIJEeedNYjuw7UR8tvvYZylgbDLQBn7AyZprddLVTj75qj bcrUOcu6PiYxVyOJXVHlF+/UdkXymbS9P+ylYXMTMCFs+BHIYyI= =I9KO -----END PGP SIGNATURE----- --lmV8o2KfPLHJV1SQIRHVEWninIHlm0SsZ--