From nobody Sat Mar 26 02:09:48 2022 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 311491A4A737 for ; Sat, 26 Mar 2022 02:09:56 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) Received: from CAN01-YT3-obe.outbound.protection.outlook.com (mail-yt3can01on2056.outbound.protection.outlook.com [40.107.115.56]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "DigiCert Cloud Services CA-1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KQMq7250fz4Yb2; Sat, 26 Mar 2022 02:09:55 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=lA3qNMFH+x/xjUh4SLNjrXhYf14JI/bHa6rUhcVE2aZFckNWXekK/wClh+CC19SfFAcwusbhtFl4HOTBrfyq+L7Re5rb7j1nWavGD2Ue9CmU9otCFm6pP8LBT8AJbzp+r3eWZBathXNZxim0UmZJsfFeFfoHC/2zAKfY+bmtY9Zb0qoL1swJbbXTG4az5ytpgWJXHleGdDfYnl1KaAKfLtRuFLXJJtI+VK7RQknkuyQTGPkaD6ahhbCYS9aoFRF+coFDuVRrVQMX0ypzq+ZvAgZ96TTomRhPkgPGH0JEe0avYQ+vlMhunfCWs0G6xGxJur/JaVNyzQ29EbqFK9YHiA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=Qjs1NXyKLFPFlKDJPrrCgUkGtmnHYIOXa7fDNkRA+0c=; b=LHH7EsFbe47dLi91cDZZ0sUPHDTMrclqClMf8yZBOfkRYGfh0GX26JVUhX73XDyWxAk78jbDBvT4V0XZFo6Erwy2qhU7btJBccrdJBzqVHfaAXJZu/3FypqXfwko8gRokwqoX8+CPR6AFtPOjQUU+FPH+tOQd8h6hFqNbFs8cfUCHIQ03ko1T+w7Hf45TSOcL3MpggkHBXdEB2i+bSrdjkJWHaB352v7so/lpTsRFBPhMC0ftc3CzzF5n6wHfugapKwHf50BU9JdrPwYQ+/lYQBBVNkgoAeGco/iyhkoAt4FXKIIMvZL2pzW2a5y0yeaK928EOGFA/89GnpYLHAg0Q== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=uoguelph.ca; dmarc=pass action=none header.from=uoguelph.ca; dkim=pass header.d=uoguelph.ca; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=uoguelph.ca; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=Qjs1NXyKLFPFlKDJPrrCgUkGtmnHYIOXa7fDNkRA+0c=; b=M1yUzXG7aL362DEV0dcAn5kHkbz1AKspJARofSsBEMuUMTjMRKMAtsJDc45YgGzcgqlwcy8IUDRoW5lDzKfc8o28uNfk8/58Qrt/9kJY2BPPU5mStY8TRz18ay8R2t2qa92J5CvHHgUvz2xwjSGWNxZxsuvQquRwbKy3ZMi0oPnf7cLB9/vxlSgL6ox3+5H2Oh8VrthgT/TkAZBkwTk1UVB3995h++vvpJRKnn5mEpDn2OQXKahiBMpbTjZNpXzDesLtyDVGjsb0OUumU6CzaGhA+cHYXnxTbtP9f7k8B1Srk70VmKmvnWZ4zzgimARL4EfWB9GkH0U1QAO2GYZ54A== Received: from YT2PR01MB9730.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:b01:de::14) by YT1PR01MB2810.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:b01:4::10) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5081.15; Sat, 26 Mar 2022 02:09:48 +0000 Received: from YT2PR01MB9730.CANPRD01.PROD.OUTLOOK.COM ([fe80::39d7:e98e:fd00:2591]) by YT2PR01MB9730.CANPRD01.PROD.OUTLOOK.COM ([fe80::39d7:e98e:fd00:2591%6]) with mapi id 15.20.5102.021; Sat, 26 Mar 2022 02:09:48 +0000 From: Rick Macklem To: John Baldwin , "freebsd-current@freebsd.org" Subject: Re: ktrace on NFSroot failing? Thread-Topic: ktrace on NFSroot failing? Thread-Index: AQHYQI/JkEo0PYUUsU+bkJKIOYzP06zQ6ftQ Date: Sat, 26 Mar 2022 02:09:48 +0000 Message-ID: References: <70135754-84c2-b642-5641-0721e0b4690d@FreeBSD.org> In-Reply-To: <70135754-84c2-b642-5641-0721e0b4690d@FreeBSD.org> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: suggested_attachment_session_id: 355a4163-888a-edad-d4e7-e8b9fd8e565e x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: 86d72eac-d265-45cf-263b-08da0ecdb450 x-ms-traffictypediagnostic: YT1PR01MB2810:EE_ x-microsoft-antispam-prvs: x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: QvHgyXRtrlWZVAvbwQ/jRE4tXKjTCtbOiatl2rxE+XtTV/8QO7xGiJ6CkLFMdfbhI2gnJp8djJklnH8O3Ubhs/aHusPYZq50bqhCU4PVQXXrZUNvF8CskVu1WdaPfC48PsCt8N5AKq1xfKPu8oniXLNxhzU5Ibfpen7I9eci2n5jKwGKwOthnNMuShqqXVPzaMVeYpdMNt6oGQl2Ba24AAvWrTbUndJMJUOhQXk1He/SPyb7h/mq+sCZMN+/pDsWBWDyBHZ+kD7MPkQCkYjnZ9Uj73Bi8dd1onpU5oX/BQpBTbYu0sNnEQCosSTW8K9zkszH3DT/DjHxQ0GWVKzTCYOts7lORqq8bbpkq0PT6ISj6qa8uUaGbmxmcEZ0fPHTdfYiFIlj5tkiZ/qe+2z1GFlxwnLSEL+qAH3iV6EgyTKpb9Engu2Silw/A1JAGAdjx4hipLC0i60pVbk+2ir7/SWQljsVvYQsF2RD7ISOGG8WtNUlAlrX96MAalrHBixLyBLSWLfAed/mtgdZFoYGhw6TvGK1saXMOJ5LJHHZzMUnz4DARo1onYCYHKI91s8mvPOvtDheXOucYH/TBBWeOzM783Po/kwtqgrBDa6E/6oOvoq+4rW8TGTm/zRQGJUm7ELhs0SM/m6Zmphv/+IwlIk9NKRMOYBP0smnm4rsM0e5F9OPqqN542IXW6JPsBmHEWVkguLiJRdJWZnIAXKn6Q== x-forefront-antispam-report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:YT2PR01MB9730.CANPRD01.PROD.OUTLOOK.COM;PTR:;CAT:NONE;SFS:(13230001)(366004)(71200400001)(186003)(6506007)(53546011)(7696005)(9686003)(83380400001)(8936002)(52536014)(2906002)(55016003)(5660300002)(110136005)(508600001)(64756008)(66946007)(76116006)(66446008)(66556008)(450100002)(66476007)(8676002)(316002)(786003)(91956017)(38070700005)(38100700002)(86362001)(3480700007)(33656002)(122000001);DIR:OUT;SFP:1101; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?iso-8859-1?Q?ZzHuiPcXWw9U/vbbhO+ukFceyAwc6gM8kCu1LtP1P0VHvZkSAj+ZDr+/Jv?= =?iso-8859-1?Q?z5u8zd6qvk4PLU94ETfDbQCGioOW5kTDrQqvez6dzym+Rju7nZec7C1iEY?= =?iso-8859-1?Q?wlwVk29FgXJVKHdmF/oGmhtE87R1M88AlesGkayCXgAEQAa5AyLxBTa7y2?= =?iso-8859-1?Q?UBHEsUOE+ersSAkJRq3bue22DC4vBKdNj2nVqrCIdDGy7Wl+hxD0oHa7yI?= =?iso-8859-1?Q?6gqxQBajJ/GTWJ/MqhVleNYaMj6hjF6kZ2NQb6KWatYPCNwCn+0hufXhzF?= =?iso-8859-1?Q?AgbyEANhVmiv5sQHMm2IXsnswB7ej4D5TJDDSG9w5RE2DRwWflQEPdX6Un?= =?iso-8859-1?Q?spmXSUmbN3vvERVu5i9DxwdcL3Ffc4WQ1R87ZgbcRzBk0d7kVpk7c9cymS?= =?iso-8859-1?Q?5d6ZHi4CyOiNVtfvUbhsljM08ofwJNqvzHUjPadoY8e1cIXwbu0IAP8dWD?= =?iso-8859-1?Q?ZtwPSCHBEX+4PwAQvApfkHd0vpDRSPBChT3xMSzJgE0NKECKBOUOH4PPcE?= =?iso-8859-1?Q?IEJR2D+6fIp/ey8nuPVT75cRfb1S0R2U7/SjJj79kmWILrZW3YmZ3nTG/X?= =?iso-8859-1?Q?ruVLkFgHiAjY5LvBLeDfd0M2eE9zq11vS10dnpP2gWARcxbltjZ2R78AO+?= =?iso-8859-1?Q?bOYE4nfq9PljT43IJFFytuF+82dNzr140wfZEEgjL7TLuOoSRUVLzx3tYq?= =?iso-8859-1?Q?N+FAV0yNJFzGUEqWkt0DJa3HibXoYqjDLYH8OX9xEfnzUf2jQ9b2Wd6rI+?= =?iso-8859-1?Q?RMrqehCIcS1pnvet0Zy5AxSVV5eMSwa9hi6V21BBKuX2rAKMWPhmAiDpL/?= =?iso-8859-1?Q?ZxQ3uACK5IkudEj5u2mM8zxqfM428x7hThXgou78LqRt48JcYJmQxVZtTh?= =?iso-8859-1?Q?vHY5SXPVoM5jdeYTMzNcjCfZbffhnP2mLPCMot4RK68j+X1RH2+rYElE5G?= =?iso-8859-1?Q?e6KRXUoP8Pz5HIqXG/wseqU6f2x4f7XFAW3MDQC/SbVFJam5MANFRwRHmA?= =?iso-8859-1?Q?PMfy52cVzNhjIKjt2nCDXxWpQvBLYwxJsC2UQczlPBwP28iDiNXXKBpVfh?= =?iso-8859-1?Q?Ie69J3hqjXlWeTJT7IDueN7BXJLwTUR+xnnCh5u0hMgmb1FtqGO2xNdGaW?= =?iso-8859-1?Q?15ze13IOPxwanUyFja5Rtuyv4kYDS1teOpL+qkh+FPdt20Z4vLWBHOtIz7?= =?iso-8859-1?Q?5+0cEPCelenXlDW/yFopZVIyrWwLp6eto1NcnoDAhL//zY2+fDQ6L1K8V8?= =?iso-8859-1?Q?Lz8toEUPns5Ywf3o+KKmonitAjo/W5UuW2go4JpfTO4DbAqQbQBaW0xdU4?= =?iso-8859-1?Q?6rd/pB2mHCWBn0b6q8ok5V32aSzsShCxSvq70RPLmgezPc91r9BjYEgHBx?= =?iso-8859-1?Q?nXp+0XOSCRNEgosCnK9GhGZ2B8ieJHJrXhjSLgYzcZ1baF9rNV5msk6vwI?= =?iso-8859-1?Q?X3aBEUi0boaxcmdgc8kHe/huLZlvxLx2MGPoklpzxleSSsNYc+E1qP6Jj/?= =?iso-8859-1?Q?k7qGLz/ExTY4kpKq75UZNzR7qyMbGdvx5tK88DIBJqg3jDSvQ4N95FnVNk?= =?iso-8859-1?Q?cx50ki3leUtqSfVgmbDeKvApQFdZ?= Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 X-OriginatorOrg: uoguelph.ca X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: YT2PR01MB9730.CANPRD01.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-Network-Message-Id: 86d72eac-d265-45cf-263b-08da0ecdb450 X-MS-Exchange-CrossTenant-originalarrivaltime: 26 Mar 2022 02:09:48.2113 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: be62a12b-2cad-49a1-a5fa-85f4f3156a7d X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: Y32v4VsJ9cusUDB7LvaG/F4tdTUN0d/etBSM7QIotEaqXl/zI6re/GjvVW2giOa3mYLSAsSgvvU5qgzaSUcD8Q== X-MS-Exchange-Transport-CrossTenantHeadersStamped: YT1PR01MB2810 X-Rspamd-Queue-Id: 4KQMq7250fz4Yb2 X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=uoguelph.ca header.s=selector2 header.b=M1yUzXG7; arc=pass ("microsoft.com:s=arcselector9901:i=1"); dmarc=pass (policy=none) header.from=uoguelph.ca; spf=pass (mx1.freebsd.org: domain of rmacklem@uoguelph.ca designates 40.107.115.56 as permitted sender) smtp.mailfrom=rmacklem@uoguelph.ca X-Spamd-Result: default: False [-5.00 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[uoguelph.ca:s=selector2]; FREEFALL_USER(0.00)[rmacklem]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:40.107.0.0/16]; MIME_GOOD(-0.10)[text/plain]; NEURAL_HAM_LONG(-1.00)[-1.000]; ARC_ALLOW(-1.00)[microsoft.com:s=arcselector9901:i=1]; DWL_DNSWL_LOW(-1.00)[uoguelph.ca:dkim]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[uoguelph.ca:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[uoguelph.ca,none]; NEURAL_HAM_SHORT(-1.00)[-1.000]; MLMMJ_DEST(0.00)[freebsd-current]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; SUBJECT_ENDS_QUESTION(1.00)[]; ASN(0.00)[asn:8075, ipnet:40.104.0.0/14, country:US]; RCVD_TLS_LAST(0.00)[]; RWL_MAILSPIKE_POSSIBLE(0.00)[40.107.115.56:from] X-ThisMailContainsUnwantedMimeParts: N John Baldwin wrote:=0A= > On 3/10/22 8:14 AM, Mateusz Guzik wrote:=0A= > > On 3/10/22, Bjoern A. Zeeb wrote:=0A= > >> Hi,=0A= > >>=0A= > >> I am having a weird issue with ktrace on an nfsroot machine:=0A= > >>=0A= > >> root:/tmp # ktrace sleep 1=0A= > >> root:/tmp # kdump=0A= > >> -559038242 Events dropped.=0A= > >> kdump: bogus length 0xdeadc0de=0A= > >>=0A= > >> Anyone seen something like this before?=0A= > >>=0A= > >=0A= > > I just did a quick check and it definitely fails on nfs mounts:=0A= > > # ktrace pwd=0A= > > /root/mjg=0A= > > # kdump=0A= > > -559038242 Events dropped.=0A= > > kdump: bogus length 0xdeadc0de=0A= > >=0A= > > I don't have time to look into it this week though.=0A= >=0A= > Possibly related: core dumps are no longer working for me on NFS=0A= > mounts. I get a 0 byte foo.core instead of a valid core dump.=0A= I just tried a core dump for a kernel built from main sources as of=0A= to-day and it worked ok.=0A= =0A= However my userland is several months old and I can't easily upgrade=0A= it for now.=0A= =0A= There was a recent ZFS problem that found its way into 13.0-p8 that=0A= I'm pretty sure is fixed now. If you had a fairly recent server exporting= =0A= ZFS, that *might* explain it?=0A= =0A= In particular, an NFSroot uses NFSv3 and nothing has changed for=0A= NFSv3 in a looonnggg time.=0A= =0A= rick=0A= =0A= --=0A= John Baldwin=0A=