From owner-freebsd-net@freebsd.org Tue Feb 23 22:40:24 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id C3D045559E0 for ; Tue, 23 Feb 2021 22:40:24 +0000 (UTC) (envelope-from Richard.Scheffenegger@netapp.com) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4DlYsh3Spgz4lkt for ; Tue, 23 Feb 2021 22:40:24 +0000 (UTC) (envelope-from Richard.Scheffenegger@netapp.com) Received: by mailman.nyi.freebsd.org (Postfix) id 76E1E555C10; Tue, 23 Feb 2021 22:40:24 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 7696B5559DF for ; Tue, 23 Feb 2021 22:40:24 +0000 (UTC) (envelope-from Richard.Scheffenegger@netapp.com) Received: from NAM12-BN8-obe.outbound.protection.outlook.com (mail-bn8nam12on20622.outbound.protection.outlook.com [IPv6:2a01:111:f400:fe5b::622]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "DigiCert Cloud Services CA-1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4DlYsg0C1tz4lYx; Tue, 23 Feb 2021 22:40:22 +0000 (UTC) (envelope-from Richard.Scheffenegger@netapp.com) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=RdK9c92GAVxQIb+xd4RsZEGofI89yN5eXA+0RnapBgth+emJ3CgMI8a/DwVYX3S6TL2bvD76ap5g9oJ4lWVwqxgOcvXOhe8G652PBM7jmXNbciyfzPpIcm5oAcethzVw0ZBPuBdFSnS8ADHYBw33pDFCpd9JBYSADSJIO9ZhKCypEyglXGWOOTICl0YXY8oaQEkJbVG8DQ/h+qqva0MHRmCV3fLTcLn7aMoM4ayayHUzIPy3+GPEG7EwpVTJPo9FgR3MVW3qeqKmW29bS7jdUmKc/MM1PF6i3LcwpNKPIxJNHWvXtohWerNp2tXxaDbFnbQ5BkyWfBzADmCIphojww== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=jfUODNgje3r/ZUi9j36bRqS9nbIVs/MmNQNVLTLUO6w=; b=hrGNNcpYxPqWlLvlyKLmCawimuSbK0w8lHpBxolvoj2OdoY+z2yMvzz9uBmoulP/oIIsNSppQVAvGqaRB6Amr4rSpEsqGHBQa7jQo6wKwTUd9ZG8ROs4srV9ZMuNdwl8LcjRKGnVTW1N3AJMFzBsi/ALNk1A/lEwpYaRwfU/pccRS+KHFp2V3u+0r4rpaRx7mg8Bo1PaYCUoavcSDTiiQZ4K7FU+/xFYAlM1D7Mzg6aFMBWFHUq24mVqpHJR2ztcDonH0Q7Sq2PVbp7WTBcppqbIQRfoZo/a/MCG3skrU84TCGwyo9tTV5dyQGIduyziZT1aTEghyFClUQdjFF/ysg== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=netapp.com; dmarc=pass action=none header.from=netapp.com; dkim=pass header.d=netapp.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=netapp.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=jfUODNgje3r/ZUi9j36bRqS9nbIVs/MmNQNVLTLUO6w=; b=gdSb/9p8mtjAYEUjc7Wl/t3nI5qyCXYBF76qBxJFA83vMzxvLfZ7EWUWmkg7iJeBtmqhVp0pIvhZZ1/WG24ITtdIej6eED9xp3XDG+ySq2bumrE6xvq7i+HHv5a3jViR+TqocjR8z95sKndriiebOhnI6a+/OrRxiQnIuVC0RDu2WSpyHTDLIacara5sOrCr1j0UNVp7x2/K2j5NTMEjO9HWp/nTOTP/kf8zc9IpqcpBr3DYeo5yTusWUDLYOtE90d6zPym/dcBL2txo1j1Y6CephLQ3pNJlXOxbnf+viTkCZi1IWKlm6W7SMk5txE9nriRoEAQ1joUAKPLDiIrmXg== Received: from SN4PR0601MB3728.namprd06.prod.outlook.com (2603:10b6:803:51::24) by SA0PR06MB6796.namprd06.prod.outlook.com (2603:10b6:806:b7::6) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3868.27; Tue, 23 Feb 2021 22:40:20 +0000 Received: from SN4PR0601MB3728.namprd06.prod.outlook.com ([fe80::b5a7:3530:77c6:2e3e]) by SN4PR0601MB3728.namprd06.prod.outlook.com ([fe80::b5a7:3530:77c6:2e3e%6]) with mapi id 15.20.3868.033; Tue, 23 Feb 2021 22:40:20 +0000 From: "Scheffenegger, Richard" To: "avg@FreeBSD.org" CC: "tuexen@freebsd.org" , "net@FreeBSD.org" Subject: AW: panic: sackhint bytes rtx >= 0 Thread-Topic: panic: sackhint bytes rtx >= 0 Thread-Index: AQHXCidGCValvkSUv0u8YX/4AZIj26pmP0UCgAAMm6A= Date: Tue, 23 Feb 2021 22:40:20 +0000 Message-ID: References: <960081ac-2839-a226-3142-5a4666eb54ad@FreeBSD.org> <8BB910F9-B828-49A2-8941-4F6C6419D8EA@freebsd.org> In-Reply-To: <8BB910F9-B828-49A2-8941-4F6C6419D8EA@freebsd.org> Accept-Language: de-AT, en-US Content-Language: de-DE X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [77.119.129.103] x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: d756f598-8e8e-4901-af7f-08d8d84c0022 x-ms-traffictypediagnostic: SA0PR06MB6796: x-microsoft-antispam-prvs: x-ms-oob-tlc-oobclassifiers: OLM:9508; x-ms-exchange-senderadcheck: 1 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: jDBbkyMRB9bimxdNObIDO44rMkFwJGuRTl9lWg75wqoLyjvkPHKxcpMdrq0XtHZbuP4tom/amQ1gTpXpjwm3yRLhLm6PZ60CIUVk7tsUrFl3bfyMEObtGhfblUvI0dOZwrd6BTQSSEaUo7wj85+i6CDWGuPbW7rDr52SnpVwU/OXr88A1neC2OhZJzhzuSAdVOFWed4VVCWmR4Rv7I23Ep3Dk6/eQ+50N80GiW3i1BuW0Q5ClSW1zS6oz1qWkvke9H1F/IO6QMJJhFx2AuggKEmRYbZyMjhrHmK9pogSyH0kQm/5YqrkSfI0E5MmC8imRqqRX3GFxazjd2Lwe6Xt39c+oQSHFw+pJUrRF9suzcvac4TqWJKvb/XlZXcKDRfb5ewmtZ6GQvwgI/nhGh/aRBbs5bD+tAamHvsDvH5pKTPjv9N58FH5pap8EQuRWwPzGBkr0BX5b/hMsoyIdb1y27SLNON8Z7mRZZoiM/bfTrwyBp505wIbZ93kwuuKb3JLTJPB83ZXO/DzUTm2dBPxHJY+AqsNVQevauokjSOHhsJF1qHhhpwCizADgXAxzydICgmwtTIVbZFYX3xF5DSFu//cOC8Ali7gcH+FVButOcg= x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:SN4PR0601MB3728.namprd06.prod.outlook.com; PTR:; CAT:NONE; SFS:(4636009)(346002)(376002)(366004)(396003)(39860400002)(136003)(6506007)(6916009)(76116006)(52536014)(66556008)(9686003)(30864003)(55016002)(71200400001)(2906002)(33656002)(966005)(8936002)(7696005)(166002)(186003)(5660300002)(4326008)(26005)(64756008)(83380400001)(54906003)(66946007)(478600001)(316002)(8676002)(66446008)(86362001)(450100002)(66476007); DIR:OUT; SFP:1101; x-ms-exchange-antispam-messagedata: =?us-ascii?Q?7EAU20U30CBLM7K3fLl8hppXiyeC+gaKBdPxZ6GhFzN+bjZmXxX2Z6apTuvB?= =?us-ascii?Q?SMRaKUw2KSNzAQsInipla14Why1wd0BlYHjFnqRitwv2kXbO1/FXnyJcozfv?= =?us-ascii?Q?Mvdt8WA6CuQYVXm5Y5w3/1fnFI0hnxpeV3CgfTHwXQBTHf0gWk9D8Poi8gtY?= =?us-ascii?Q?2qEFifSi8hqvWsQnyNHsbKNczeMIWJYNq1ELkYtymZWKRHz3vOPvLefHoYP2?= =?us-ascii?Q?iX/bv6xmqA6SlD4W1uVoz/fRgo8rkeUvux564EGlVGHJk/l4BxPkuYJBDr9+?= =?us-ascii?Q?7fpordEc02KXYZt6tI7GOQonevv2VzB3RVfMNf08lBnxuRe1mQVhWHFqK29E?= =?us-ascii?Q?po2pfOJt8dzwMCg7obJaj8Aodw1FqkyVNc6JJPAht25SFlP3Nsk7mr7JQyLD?= =?us-ascii?Q?r/rd53L5MF+hFyN0xc7KL1RZaxRxxUrgwbM+Nuy+RFzr8CX3GPfY7+xuBnre?= =?us-ascii?Q?Ke6Uxv0EvHge3F6gcEDpQ5WbJ/8iU29gZc/WhSyzHnJ4Eh46XuYmpGuXMzNW?= =?us-ascii?Q?ca4YyqoUkb3ikjJWlcAlBDSu3kj0kFVunHMwz+ydevITbkDs8wrgsdqpuaOK?= =?us-ascii?Q?iaL/Da8B4S/po5ukeVe5QaBDTAJ3bS/A1LQrD918sedamNpfOZBSUzixsvar?= =?us-ascii?Q?1n7M/7F5SIKhOURTWM7qnAUhzr2IGDClbQa6magIiXB27dUzUWLwn2iIsCeZ?= =?us-ascii?Q?HfQ20MgeKSuSKy4GehhDk+Eo844rZXBxPwVs/fg3f5MskWUF549R1B+yjBdr?= =?us-ascii?Q?psr2NyfA7vrdGp0Sc206fMqP1uB+Bm6f8Mzvg9sTMaMqmPFaXmXEfT3Ik50/?= =?us-ascii?Q?Btb8KMlGXndGQkZj3t3hNc77H7pCbnJl/A3TfUpIepB1JfL6IDEcBeXromfP?= =?us-ascii?Q?1GcdETvXuD2wusNnx6aChi9429WFfZ1NkznuxIgUhbosDvxBHvweH7Uf1MOC?= =?us-ascii?Q?+erOjH4NpIU+/r4LUgUimz/+rNGuDU3Bote2faVynyxdGF0VzjaOef+tU9JL?= =?us-ascii?Q?egmF79Pj0lEKmBn+eomI7mQ0pYPyupYcX2YW5PBICpVO0WN4iHlHZlyj1YZ3?= =?us-ascii?Q?9ERhNCJmBkupLWXU0pSr7MWv87pdLhjNsd9FpuUaS5jZEXy0kcdrQEGX4y72?= =?us-ascii?Q?aqfUM6Wq1aWmnBFdd5QChURMUR65uHjZQjDa/5W1ofKsPTC0oSm4HozDwqHc?= =?us-ascii?Q?XPfixYGaSv5clgrfGS68rV/CwmBMK9O4p2BPKh5r8UdNR5zMEX2vQzBzJ0uw?= =?us-ascii?Q?Df5jAoM46O2ALLIvXXN2nsXk4N8O7M7Sq5GGg9rLFmfETdgbxhKlofFEZku3?= =?us-ascii?Q?lnT7M5OoHhT/p8cnD7RJRv71?= x-ms-exchange-transport-forked: True MIME-Version: 1.0 X-OriginatorOrg: netapp.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: SN4PR0601MB3728.namprd06.prod.outlook.com X-MS-Exchange-CrossTenant-Network-Message-Id: d756f598-8e8e-4901-af7f-08d8d84c0022 X-MS-Exchange-CrossTenant-originalarrivaltime: 23 Feb 2021 22:40:20.3782 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 4b0911a0-929b-4715-944b-c03745165b3a X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: BTE9U1YZktBwbLVvwQrer2VdIaF3LFRaA/lriwTxkXgkX7D5RmMFt10u58R08mKxNkhGp1LXvlIh6j7E+H0r/g== X-MS-Exchange-Transport-CrossTenantHeadersStamped: SA0PR06MB6796 X-Rspamd-Queue-Id: 4DlYsg0C1tz4lYx X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=netapp.com header.s=selector1 header.b=gdSb/9p8; arc=pass (microsoft.com:s=arcselector9901:i=1); dmarc=pass (policy=none) header.from=netapp.com; spf=pass (mx1.freebsd.org: domain of Richard.Scheffenegger@netapp.com designates 2a01:111:f400:fe5b::622 as permitted sender) smtp.mailfrom=Richard.Scheffenegger@netapp.com X-Spamd-Result: default: False [-6.00 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; RBL_DBL_DONT_QUERY_IPS(0.00)[2a01:111:f400:fe5b::622:from]; R_DKIM_ALLOW(-0.20)[netapp.com:s=selector1]; HAS_XOIP(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2a01:111:f400::/48]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; NEURAL_HAM_LONG(-1.00)[-1.000]; SPAMHAUS_ZRD(0.00)[2a01:111:f400:fe5b::622:from:127.0.2.255]; RCVD_COUNT_THREE(0.00)[3]; DWL_DNSWL_LOW(-1.00)[netapp.com:dkim]; DKIM_TRACE(0.00)[netapp.com:+]; DMARC_POLICY_ALLOW(-0.50)[netapp.com,none]; NEURAL_HAM_SHORT(-1.00)[-0.999]; TO_DN_EQ_ADDR_ALL(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:8075, ipnet:2a01:111:f000::/36, country:US]; ARC_ALLOW(-1.00)[microsoft.com:s=arcselector9901:i=1]; MAILMAN_DEST(0.00)[net] Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.34 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 23 Feb 2021 22:40:24 -0000 Hi Andriy, I guess I am currently the person who has the most recent knowledge about t= hat part of the base stack... Do you happen to have more (preceding) information about this, or a way to = reproduce this? Are you running any special stack (RACK, BBR) which may have switched back = to the base stack in the middle of a loss recovery (I suspected at one poin= t that this may cause issues, potentially)? Or was something done with the ipfw that may have temporarily impacted a tc= p session? The accounting with sack_bytes_rexmit is rather old, and not touched recent= ly (but the sackhint struct was changed recently, and other/additional scor= eboard accounting was added). (kgdb) p *cur $1 =3D {start =3D 3846347980, end =3D 3846352300, rxmit =3D 3846352300, scb= link =3D {tqe_next =3D 0xfffff8013da5a220, tqe_prev =3D 0xfffff80754818930}} This indicates, that the current hole in the SACK scoreboard (3 segments of= size 1440 bytes) were retransmitted (rxmit =3D=3D end), before the curren= t acknowledgement came back. Thus the expectation is, that sackhint.sack_bytes_rexmit also has a value o= f at least that number of bytes (4320). It is increased in tcp_output() for= each packet leaving while performing a retransmission. But this is the peculiar part: (kgdb) p tp@entry->sackhint.sack_bytes_rexmit $3 =3D -1440 Indicating negative one packet had been retransmitted before (thus subtract= ing the hole, which was previously retransmitted violates the invariant). A= nd the only piece of code decrementing it appears to be in tcp_output() dur= ing non-permanent error handling... All updates to sackhint should be protected by the INPLOCK, so even if the = rx and tx paths are running on different core, the sack_bytes_rexmit should= never become negative. The sack blocks returned indicate that (with snd.una as zero baseline, in s= egments) the client knows about segments 2..34 and 35..47. The first hole has shrunk from the right (unusual; possible when two retran= smissions were lost again, or the 3 segment originally sent, delayed by ~50= segments (unlikely). Sorry to not being able to spot something obvious right away... Richard Scheffenegger Consulting Solution Architect NAS & Networking NetApp +43 1 3676 811 3157 Direct Phone +43 664 8866 1857 Mobile Phone Richard.Scheffenegger@netapp.com https://ts.la/richard49892 Von: tuexen@freebsd.org Gesendet: Dienstag, 23. Februar 2021 22:21 An: Richard Scheffenegger Betreff: Fwd: panic: sackhint bytes rtx >=3D 0 NetApp Security WARNING: This is an external email. Do not click links or o= pen attachments unless you recognize the sender and know the content is saf= e. FYI Begin forwarded message: From: Andriy Gapon > Subject: panic: sackhint bytes rtx >=3D 0 Date: 23. February 2021 at 22:02:20 CET To: FreeBSD Current >, net@= FreeBSD.org Got this panic on 13.0-STABLE 4b2a20dfde9c using a custom kernel with INVAR= IANTS enabled. Below is some information from the crash dump. If anyone has any clues, suggestions, etc, please help. I will try to help you to help me the best I can. #0 doadump (textdump=3Dtextdump@entry=3D1) at /usr/devel/git/trant/sys/kern/kern_shutdown.c:399 #1 0xffffffff808396b2 in kern_reboot (howto=3D260) at /usr/devel/git/trant/sys/kern/kern_shutdown.c:486 #2 0xffffffff80839d07 in vpanic ( fmt=3D0xffffffff80cbd551 "sackhint bytes rtx >=3D 0", ap=3D0xfffffe0120b= 9e6d0) at /usr/devel/git/trant/sys/kern/kern_shutdown.c:919 #3 0xffffffff808398b3 in panic (fmt=3D) at /usr/devel/git/trant/sys/kern/kern_shutdown.c:843 #4 0xffffffff8098a82c in tcp_sack_doack (tp=3D, tp@entry=3D0xfffff807548187f0, to=3D, to@entry=3D0xfffffe0120b9e780, th_ack=3D) at /usr/devel/git/trant/sys/netinet/tcp_sack.c:691 #5 0xffffffff80983699 in tcp_do_segment (m=3D0xfffff8029868ca00, m@entry=3D, th=3D, th@entry=3D, so=3D0xfffff804e7359b10, so@entry=3D, tp=3D0xfffff807548187f0, tp@entry=3D, drop_hdrlen=3D60, drop_hdrlen@entry=3D, tlen=3D, tlen@entry=3D, iptos=3D72 'H', iptos@entry=3D) at /usr/devel/git/trant/sys/netinet/tcp_input.c:2497 #6 0xffffffff80980d97 in tcp_input (mp=3D, mp@entry=3D, offp=3D, offp@entry=3D, proto=3D) at /usr/devel/git/trant/sys/netinet/tcp_input.c:1381 #7 0xffffffff80976eb7 in ip_input (m=3D0x0) at /usr/devel/git/trant/sys/netinet/ip_input.c:833 #8 0xffffffff8094c78f in netisr_dispatch_src (proto=3D1, source=3Dsource@entry=3D0, m=3D0xfffff8029868ca00) at /usr/devel/git/trant/sys/net/netisr.c:1143 #9 0xffffffff8094cb0e in netisr_dispatch (proto=3D, m=3D) at /usr/devel/git/trant/sys/net/netisr.c:1234 #10 0xffffffff80943345 in ether_demux (ifp=3Difp@entry=3D0xfffff80008c75000= , m=3D) at /usr/devel/git/trant/sys/net/if_ethersubr.c:923 #11 0xffffffff809446c1 in ether_input_internal (ifp=3D0xfffff80008c75000, m=3D) at /usr/devel/git/trant/sys/net/if_ethersubr.c:709 #12 0xffffffff809443d0 in ether_nh_input (m=3D) at /usr/devel/git/trant/sys/net/if_ethersubr.c:739 #13 0xffffffff8094c78f in netisr_dispatch_src (proto=3Dproto@entry=3D5, source=3Dsource@entry=3D0, m=3Dm@entry=3D0xfffff8029868ca00) at /usr/devel/git/trant/sys/net/netisr.c:1143 #14 0xffffffff8094cb0e in netisr_dispatch (proto=3D, proto@entry=3D5, m=3D, m@entry=3D0xfffff8029868ca00) at /usr/devel/git/trant/sys/net/netisr.c:1234 #15 0xffffffff8094383d in ether_input (ifp=3D0xfffff80008c75000, ifp@entry=3D, m=3D0xfffff8029868ca00, m@entry=3D) at /usr/devel/git/trant/sys/net/if_ethersubr.c:830 #16 0xffffffff8066da13 in re_rxeof (sc=3Dsc@entry=3D0xfffffe00391a5000, rx_npktsp=3D0x0) at /usr/devel/git/trant/sys/dev/re/if_re.c:2388 #17 0xffffffff8066b3ab in re_intr_msi (xsc=3D0xfffffe00391a5000) at /usr/devel/git/trant/sys/dev/re/if_re.c:2684 #18 0xffffffff80801bcf in intr_event_execute_handlers ( p=3Dp@entry=3D0xfffff80006a94a50, ie=3Die@entry=3D0xfffff80008c57800) at /usr/devel/git/trant/sys/kern/kern_intr.c:1168 #19 0xffffffff80801942 in ithread_execute_handlers ( p=3Dp@entry=3D0xfffff80006a94a50, ie=3Die@entry=3D0xfffff80008c57800) at /usr/devel/git/trant/sys/kern/kern_intr.c:1181 #20 0xffffffff80801758 in ithread_loop (arg=3Darg@entry=3D0xfffff80008c20c4= 0) at /usr/devel/git/trant/sys/kern/kern_intr.c:1269 #21 0xffffffff807fe0a9 in fork_exit ( callout=3D0xffffffff808016c0 , arg=3D0xfffff80008c20c40, frame=3D0xfffffe0120b9ed40) at /usr/devel/git/trant/sys/kern/kern_fork.c:1069 (kgdb) fr 4 #4 0xffffffff8098a82c in tcp_sack_doack (tp=3D, tp@entry=3D0xfffff807548187f0, to=3D, to@entry=3D0xfffffe012= 0b9e780, th_ack=3D) at /usr/devel/git/trant/sys/netinet/tcp_sack.c:69= 1 691 KASSERT(tp->sackhint.sack_bytes_rexmit >=3D 0, (kgdb) i loc sack_blocks =3D {{start =3D 3846350860, end =3D 3846396940}, {start =3D 384= 6398380, end =3D 3846415660}, {start =3D 0, end =3D 0}, {start =3D 1417775088, end =3D 4= 294965255}, {start =3D 549054304, end =3D 4294966785}} left_edge_delta =3D delivered_data =3D 0 sack_changed =3D num_sack_blks =3D i =3D j =3D sack =3D {start =3D , end =3D } sblkp =3D 0xfffffe0120b9e700 temp =3D cur =3D 0xfffff8013da5a320 (kgdb) p *cur $1 =3D {start =3D 3846347980, end =3D 3846352300, rxmit =3D 3846352300, scb= link =3D {tqe_next =3D 0xfffff8013da5a220, tqe_prev =3D 0xfffff80754818930}} (kgdb) p 3846352300 - 3846347980 $2 =3D 4320 (kgdb) p tp->sackhint.sack_bytes_rexmit value has been optimized out (kgdb) p tp@entry->sackhint.sack_bytes_rexmit $3 =3D -1440 (kgdb) p 4320 - 1440 $4 =3D 2880 (kgdb) p *sblkp $5 =3D {start =3D 3846350860, end =3D 3846396940} (kgdb) p *tp@entry $7 =3D {t_inpcb =3D 0xfffff80640ca65b8, t_fb =3D 0xffffffff80ef4700 , t_fb_ptr =3D 0x0, t_maxseg =3D 1440, t_logstate =3D 0, t_port =3D 0, t_stat= e =3D 4, t_idle_reduce =3D 0, t_delayed_ack =3D 0, t_fin_is_rst =3D 0, t_log_state_set =3D 0, bits_spare =3D 0, t_flags =3D 1613759072, snd_una = =3D 3846347980, snd_max =3D 3846417100, snd_nxt =3D 3846417100, snd_up =3D 3846= 347980, snd_wnd =3D 237568, snd_cwnd =3D 4320, t_peakrate_thr =3D 0, ts_offset =3D = 71449215, rfbuf_ts =3D 162235772, rcv_numsacks =3D 0, t_tsomax =3D 0, t_tsomaxsegcou= nt =3D 0, t_tsomaxsegsize =3D 0, rcv_nxt =3D 2281639092, rcv_adv =3D 2281705332, rcv_= wnd =3D 66240, t_flags2 =3D 1030, t_srtt =3D 876, t_rttvar =3D 33, ts_recent =3D 0, snd_scale =3D 8 '\b', rcv_scale =3D 6 '\006', snd_limited =3D 2 '\002', request_r_scale =3D 6 '\006', last_ack_sent =3D 2281639092, t_rcvtime =3D 2= 309118641, rcv_up =3D 2281639092, t_segqlen =3D 0, t_segqmbuflen =3D 0, t_segq =3D { tqh_first =3D 0x0, tqh_last =3D 0xfffff80754818880}, t_in_pkt =3D 0x0, t= _tail_pkt =3D 0x0, t_timers =3D 0xfffff80754818a78, t_vnet =3D 0x0, snd_ssthresh =3D = 31680, snd_wl1 =3D 2281639092, snd_wl2 =3D 3846347980, irs =3D 2281631223, iss =3D 3840447913, t_acktime =3D 0, t_sndtime =3D 2309118613, ts_recent_a= ge =3D 0, snd_recover =3D 3846415660, cl4_spare =3D 0, t_oobflags =3D 0 '\000', t_iob= c =3D 0 '\000', t_rxtcur =3D 270, t_rxtshift =3D 1, t_rtttime =3D 2309118613, t_rtseq =3D 3846415660, t_starttime =3D 2309086941, t_fbyte_in =3D 2309087= 188, t_fbyte_out =3D 2309087159, t_pmtud_saved_maxseg =3D 0, t_blackhole_enter = =3D 0, t_blackhole_exit =3D 0, t_rttmin =3D 30, t_rttbest =3D 845, t_softerror =3D= 0, max_sndwnd =3D 237568, snd_cwnd_prev =3D 64800, snd_ssthresh_prev =3D 8640= , snd_recover_prev =3D 3846347980, t_sndzerowin =3D 0, t_rttupdated =3D 368, snd_numholes =3D 2, t_badrxtwin =3D 0, snd_holes =3D {tqh_first =3D 0xfffff= 8013da5a320, tqh_last =3D 0xfffff8013da5a230}, snd_fack =3D 3846415660, sackblks =3D = {{start =3D 2281632180, end =3D 2281632690}, {start =3D 0, end =3D 0}, {start =3D 0, en= d =3D 0}, {start =3D 0, end =3D 0}, {start =3D 0, end =3D 0}, {start =3D 0, end =3D 0= }}, sackhint =3D {nexthole =3D 0xfffff8013da5a220, sack_bytes_rexmit =3D -1440= , last_sack_ack =3D 3846415660, delivered_data =3D 1440, sacked_bytes =3D 619= 20, recover_fs =3D 67680, prr_delivered =3D 1440, _pad =3D {0}}, t_rttlow =3D 2= 5, rfbuf_cnt =3D 0, tod =3D 0x0, t_sndrexmitpack =3D 520, t_rcvoopack =3D 0, = t_toe =3D 0x0, cc_algo =3D 0xffffffff80ef2530 , ccv =3D 0xfffff80754818bc= 0, osd =3D 0x0, t_bytes_acked =3D 11520, t_maxunacktime =3D 0, t_keepinit =3D 0, t_keepidle =3D 0, t_keepintvl =3D 0, t_keepcnt =3D 0, t_dupacks =3D 4, t_l= ognum =3D 0, t_loglimit =3D 0, t_pacing_rate =3D -1, t_logs =3D {stqh_first =3D 0x0, stq= h_last =3D 0x0}, t_lin =3D 0x0, t_lib =3D 0x0, t_output_caller =3D 0x0, t_stats =3D 0x= 0, t_logsn =3D 0, gput_ts =3D 0, gput_seq =3D 0, gput_ack =3D 0, t_stats_gput= _prev =3D 0, t_tfo_client_cookie_len =3D 0 '\000', t_end_info_status =3D 0, t_tfo_pendin= g =3D 0x0, t_tfo_cookie =3D {client =3D '\000' , server =3D 0}, { t_end_info_bytes =3D "\000\000\000\000\000\000\000", t_end_info =3D 0}} (kgdb) p *tp@entry->sackhint.nexthole $8 =3D {start =3D 3846396940, end =3D 3846398380, rxmit =3D 3846398380, scb= link =3D {tqe_next =3D 0x0, tqe_prev =3D 0xfffff8013da5a330}} -- Andriy Gapon _______________________________________________ freebsd-current@freebsd.org mailing lis= t https://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to "freebsd-current-unsubscribe@freebsd.org"