From nobody Mon Aug 14 06:05:13 2023 X-Original-To: freebsd-net@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RPP5F11vlz4mRms; Mon, 14 Aug 2023 06:05:21 +0000 (UTC) (envelope-from schakrabarti@microsoft.com) Received: from HK2P15301CU002.outbound.protection.outlook.com (mail-eastasiaazon11020017.outbound.protection.outlook.com [52.101.128.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "DigiCert Cloud Services CA-1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RPP5C5jsdz3TFw; Mon, 14 Aug 2023 06:05:19 +0000 (UTC) (envelope-from schakrabarti@microsoft.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=microsoft.com header.s=selector2 header.b=FJDCVMZn; arc=pass ("microsoft.com:s=arcselector9901:i=1"); spf=pass (mx1.freebsd.org: domain of schakrabarti@microsoft.com designates 52.101.128.17 as permitted sender) smtp.mailfrom=schakrabarti@microsoft.com; dmarc=pass (policy=reject) header.from=microsoft.com ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=HJANdxe8mRiGCPoFWQ/alueQer8vh72EUbAMlkUNMtzCkmutyedf1LU1YK24bQjbgkfdBA90Mwb8RfOG9TkT99eu4OZrLn8zqWAnV/ILVScsNipGc8R9T4OgyasVHIQunlr1vQm6bJ5NpAjmgy2uW4iM1MeC7qgoluVre4lij9fBHwMJ1I03LFKTk/tG82DKRdz17Oqs1tMGN9Lo8l7bfz+3+nN0eY5C9H6KnsgggFqjGqbaoLoayRNHZxXYRDn3Fd7ZCQeYWzfD1kBJkoyFnREpcL5B9Pl6UhPRhYSt3RAeoJJFnYRDbsOKdaRSIHltxL6Y+4JXs9NfAhHPHwEYIQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=++3CPHI0CYZwfvOumGRIyaFvd9H/DlfaKk7ih8oqTEY=; b=N90sdd5IUhUOUSdI7Jo3NjFag9DhRJHdccw3itu3QuHBfIMlcZNGCSVdl7LdbUGQVveXFlgu8qB9CXxmWFmOYjOHG3hXi6/lCtkvG596wQMKO5EK7nfhVGtbYQwsRLeX0amZJ+f+wITZOiQbqoLP68RfS8fCUYbL+3hPZSaKeyqNr2H5FdSAmGNpBgOFdt0hnoOpKVK5GDo/0GQcKdc9Kj3Ib9VJQ2Y0BSIC8Oa7LcrMnOAWh8tiztTNqguKorRp4PfUftgsAkcQsrb8+uKmsbqhfJsc6nGLXVQX1dPY1eQ2ZFpRc1aflH6DUOOOJ+Cv7tzp0PJojvIh4+z7fI3XZQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=microsoft.com; dmarc=pass action=none header.from=microsoft.com; dkim=pass header.d=microsoft.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=++3CPHI0CYZwfvOumGRIyaFvd9H/DlfaKk7ih8oqTEY=; b=FJDCVMZnSlx8DgkL2i0X5LKJu3y7/g03b0d00mosmPYNZFeyfk9pT+laQzniPCct++iGtp85/bNfZp4cQVl64oX3S6lNL8kmT8TcYb16uoOgtL5ATfloDp95wWyB8Zk7a1KSKHWj1hPTOVulRB56GlMsZRN7IU8aQ5STgyG/Ixs= Received: from PUZP153MB0788.APCP153.PROD.OUTLOOK.COM (2603:1096:301:fc::10) by TYZP153MB0737.APCP153.PROD.OUTLOOK.COM (2603:1096:400:261::14) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6699.9; Mon, 14 Aug 2023 06:05:13 +0000 Received: from PUZP153MB0788.APCP153.PROD.OUTLOOK.COM ([fe80::abe0:95e:5348:dd5a]) by PUZP153MB0788.APCP153.PROD.OUTLOOK.COM ([fe80::abe0:95e:5348:dd5a%4]) with mapi id 15.20.6699.008; Mon, 14 Aug 2023 06:05:13 +0000 From: Souradeep Chakrabarti To: "freebsd-arm@FreeBSD.org" , "freebsd-hackers@FreeBSD.org" , "freebsd-net@FreeBSD.org" CC: Wei Hu Subject: Panic in add_route while rebooting in Azure ARM64 bug 272666 Thread-Topic: Panic in add_route while rebooting in Azure ARM64 bug 272666 Thread-Index: AdnOdUjFmvmJxBuLSVGs5MdJ4NrR9Q== Date: Mon, 14 Aug 2023 06:05:13 +0000 Message-ID: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: msip_labels: MSIP_Label_f42aa342-8706-4288-bd11-ebb85995028c_ActionId=761ba4b8-aeaf-4cda-8250-2a27f1120894;MSIP_Label_f42aa342-8706-4288-bd11-ebb85995028c_ContentBits=0;MSIP_Label_f42aa342-8706-4288-bd11-ebb85995028c_Enabled=true;MSIP_Label_f42aa342-8706-4288-bd11-ebb85995028c_Method=Standard;MSIP_Label_f42aa342-8706-4288-bd11-ebb85995028c_Name=Internal;MSIP_Label_f42aa342-8706-4288-bd11-ebb85995028c_SetDate=2023-08-14T05:56:59Z;MSIP_Label_f42aa342-8706-4288-bd11-ebb85995028c_SiteId=72f988bf-86f1-41af-91ab-2d7cd011db47; x-ms-publictraffictype: Email x-ms-traffictypediagnostic: PUZP153MB0788:EE_|TYZP153MB0737:EE_ x-ms-office365-filtering-correlation-id: fc1d94f7-ece9-4b35-a1d9-08db9c8c6c9f x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: jtchdVx/5uSEySy3ceswgnS8r4kkfWQ3ctgNcwLDuwlLKmj+KAE8MVBdUiNvFtt0dBn1nAqw+8W9S2bepSvp66EjBNcn+z9RB5bP4t4CXVOy/MyNvM75FBebODAn/Fp3fxsbq5sYypZQiY0YQZqjkGCTaOwCInS0CPE7qXZNak5SaU/J20xvXcjWb/keF5HwwwMn1UQv/yOuq82WOAHVwj5LpTDiXMCnlW8Vo19Qo/bPoX1Ruu4HLPBIjTfwe2adHk5ggbZ6037WF9i50D/gi23VBR03QPSsK80vc5q48MHEKcICpn4GaCnr/OPfHRzHIZ9hmB548+t/FGiBJ6Yv4dya3Qq485tU5R80qckNGuZTYNSJ1jZkgp+QcPGOPuPdl8ll3whDI9D/RsxunW8jOLX6RX8+n2G1zJuWIbCG6nSnlmOYkgqd10Xn26hfZWew/LAghVQMy23UgNzjHAxoSKD7OK3/xMzwAH9D3DLh9p5FgLWkQZmxeze5KFRID9nZH9oqk3uwMIaAVMFgrgGUOQ8p4i+/AYiqJt2GNsHhfAPsqcDYermJpwLsewgvk6URVfwv4uG3goneWIDqkKwjJFFkgcpjgRg+st5tS4ZpMVlKP93/dBka3rwaGLQQ1Kc00xbEM3hS0qoFj3CxReBgUl8vZpOWj7Pd1wJteolJWOjUkcV8GV1ReoO7TlPyXgMH x-forefront-antispam-report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:PUZP153MB0788.APCP153.PROD.OUTLOOK.COM;PTR:;CAT:NONE;SFS:(13230028)(346002)(396003)(376002)(39860400002)(366004)(136003)(186006)(451199021)(1800799006)(12101799016)(966005)(9686003)(8936002)(86362001)(55016003)(33656002)(38070700005)(122000001)(82950400001)(82960400001)(38100700002)(26005)(6506007)(2906002)(10290500003)(83380400001)(71200400001)(7696005)(478600001)(450100002)(4326008)(41300700001)(107886003)(110136005)(8676002)(316002)(66446008)(66476007)(8990500004)(5660300002)(64756008)(66946007)(66556008)(76116006)(52536014);DIR:OUT;SFP:1102; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?us-ascii?Q?gNeLjKnBvnYy6zqrIZvF6CSWVPzvvZSeHMiy0Nj8noet5k6plKU86RFmMSKA?= =?us-ascii?Q?tuF9sfrqY0AgkdwvxpiOpMso28xSngeintVxY3cp1Pp83Mdh1Zf5uBO1/VxF?= =?us-ascii?Q?iKAv8Kt9wnWuSQzYXGAoJNBvF0UQ9cw+W1uHniFWWvNz13sVly/ZhhEt2SEN?= =?us-ascii?Q?AxOz5z6yw/4+I6TFsnms9FlizsGanuyxdeT3PhGN+sOqn3uHAeNIefCeAjtT?= =?us-ascii?Q?YB9U3ykRP5y1ifQmX+TrFfWDHZBkfpEoV3WlSVf56eLEYPHOVf6BHzlIsotL?= =?us-ascii?Q?rrDrItrpH/HhRO3gy3/K9VG5+r9jKMpeMiSSefctylU2eE6QTAaKxXU2qL42?= =?us-ascii?Q?qdV43lm6OPsMGKCFqa4Gb52rLeDYUHun1ySt21CsTKVGguS+DQAlEDOBCeZn?= =?us-ascii?Q?LGTvIMNn3KzneZAA6ghNesyXzestopSrNdX1zB+h3Ccnl3hEpc4lCzrTN7+S?= =?us-ascii?Q?FS2Y+dg/AIc+RYle2d904qrbS21reOmN9IStn1e95NHd3H+1tNB0ZW8+jp90?= =?us-ascii?Q?HyaysDdbPf7DDoz8VBk7siu9lCh0wYn4zGJM3cigu8KwAK5N9yFbn+HF7GQZ?= =?us-ascii?Q?xQ20nMyp9uq+4yWJ2rqMax+SX+h9ReEWXnDZlMBJbQcnZtZ39/gPaJ0vL+XD?= =?us-ascii?Q?AfotAFO+f631UIJPgk2EQwPA8haEd+Dkpppar+9btRtgnTdF+vX7LKy0Krvy?= =?us-ascii?Q?tz9sTF1tmc+5QYfFDj7WotDhPLbT6M77WK0LN4NRLzqECBm+iJ41kV0Q5IAy?= =?us-ascii?Q?vSatj4k6ObBtlnmmum8eZnKJ0Lf1tqqE9m+PDZBagwTw1NC6wlU08M2dk2+5?= =?us-ascii?Q?X0pifoNVspcH5cSPfAlo24HdSoLSBQ1iffTu9QQSkR1d/gWyE9h21k8XMdHv?= =?us-ascii?Q?uFlb85HAcq0GTUQrjpE1Xfz3HyZMHhrT69HHnbV9VOAI61HpCvfpIWqdVRgD?= =?us-ascii?Q?U7tvW6IlfEHeVyoHx1jj6u+vhNrdNrF4lUXyFfzKcvQEhRxzXv5dSrl1cUTB?= =?us-ascii?Q?5XRcza8nWCD/+BeLRonm+GAzy0TVwetzu3r58iV1kFMRBIvXdtJW6vYh9+VP?= =?us-ascii?Q?VeDFgD7BI9DcAzB1Ikx/Hfj1RvjIjxDbtgQXur9nJCzEMWvcxVFzmLuO7nfV?= =?us-ascii?Q?tbv4VGz10IaT5qU5EcPvde7401zS0Dg7bB6aJ85MqTKsGcvbw6eXQ+/C8atC?= =?us-ascii?Q?P6PGeQbIRc2laVP0AxvHIlkPJYrtKwDvBlUKTrwbckNCE5V2CUT1wFFRG9Kl?= =?us-ascii?Q?3eZEWWbySJLSguO7ZtWw0u0zy9AUIvm5ovDKFZEjjZGk/t+v2jS+KAw5Sn9W?= =?us-ascii?Q?ya4RtToXd/hD8YYRP1gGUhV6pnuI9TC7UZs+z+ZEk/naIeMLao1MWTOT8/Bc?= =?us-ascii?Q?Y18uXcE2XyIlGUFtFrg7kA8dCSAgEssjYHN1QJitU5AuLOdpgomGZWndJGHs?= =?us-ascii?Q?QSOqQdmTtklIAIZiEvA+cyIe7AwJRz2sQVzijeEXQG1ftIup/ulGnKvoXfCN?= =?us-ascii?Q?wN5Q5QlfeiftRFXO3Igs70kliyiMsznODTYC?= Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable List-Id: Networking and TCP/IP with FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-net List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-net@freebsd.org MIME-Version: 1.0 X-OriginatorOrg: microsoft.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: PUZP153MB0788.APCP153.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-Network-Message-Id: fc1d94f7-ece9-4b35-a1d9-08db9c8c6c9f X-MS-Exchange-CrossTenant-originalarrivaltime: 14 Aug 2023 06:05:13.4726 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 72f988bf-86f1-41af-91ab-2d7cd011db47 X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: KlJjWYIKjiGD3JQn8fUTiAgesJy0vIO6sKTdZLGKdq1iGlOnWtzLxbCv67tbSBgTHJtkJdrfccPoH2R43RWFQOBkWRqZTtoTdHy8GhitqkQ= X-MS-Exchange-Transport-CrossTenantHeadersStamped: TYZP153MB0737 X-Spamd-Result: default: False [-9.00 / 15.00]; WHITELIST_SPF_DKIM(-3.00)[microsoft.com:d:+,microsoft.com:s:+]; ARC_ALLOW(-1.00)[microsoft.com:s=arcselector9901:i=1]; DWL_DNSWL_LOW(-1.00)[microsoft.com:dkim]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.999]; DMARC_POLICY_ALLOW(-0.50)[microsoft.com,reject]; R_SPF_ALLOW(-0.20)[+ip4:52.100.0.0/14]; R_DKIM_ALLOW(-0.20)[microsoft.com:s=selector2]; MIME_GOOD(-0.10)[text/plain]; MLMMJ_DEST(0.00)[freebsd-arm@FreeBSD.org,freebsd-hackers@freebsd.org,freebsd-net@FreeBSD.org]; ASN(0.00)[asn:8075, ipnet:52.96.0.0/12, country:US]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[microsoft.com:+]; FROM_HAS_DN(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[52.101.128.17:from]; RCPT_COUNT_THREE(0.00)[4]; RCVD_COUNT_TWO(0.00)[2]; TO_DN_SOME(0.00)[]; TO_DN_EQ_ADDR_SOME(0.00)[] X-Spamd-Bar: -------- X-Rspamd-Queue-Id: 4RPP5C5jsdz3TFw Hi, We are working on bringing FreeBSD on Azure ARM64. Now with recently releas= ed FreeBSD arm64 preview image in Azure, when doing reboot from serial console, FreeBSD is going into panic w= hile coming up. It is happening almost every 2nd, or=20 3rd attempt. The below is the panic. LF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/l= ib/compat/pkg /usr/local/lib/compat/pkg lo0: link state changed to UP Kernel page fault with the following non-sleepable locks held: exclusive rm rib head lock (rib head lock) r =3D 0 (0xffffa000012278e0) loc= ked @ /usr/src/sys/net/route/route_ctl.c:797 stack backtrace: #0 0xffff0000004d2af4 at witness_debugger+0x5c #1 0xffff0000004d3cf8 at witness_warn+0x400 #2 0xffff0000007f7310 at data_abort+0xa0 #3 0xffff0000007d3014 at handle_el1h_sync+0x14 x0: 0x0000000000000001 x1: 0x0000000000000100 x2: 0xffffa00001ae7000 x3: 0xffff00004031af40 ($d.2 + 0x3efee96f) x4: 0x0000000000000100 x5: 0x0000000000000000 x6: 0x000000000000003f x7: 0x0000000000000000 x8: 0xffff000132c76c40 x9: 0x0000000000000000 x10: 0x0000000000000008 x11: 0x0000000000000000 x12: 0x000000000000003e x13: 0xffffa00001ae70fc x14: 0x0000000000000000 x15: 0x0000000000000001 x16: 0x0000000000010000 x17: 0x0000000000000005 x18: 0xffff00012d2f7e60 x19: 0xffff00012d2f8080 x20: 0xffffa00001227800 x21: 0x0000000000000000 x22: 0xdeadc0dedeadc0de x23: 0xffffa000012278e0 x24: 0xffffa00001227800 x25: 0xffffa0000c93ba00 x26: 0xffff000000960582 (digits + 0x12fbf) x27: 0xffffa0000c9338f0 x28: 0x0000000000000000 x29: 0xffff00012d2f7e60 sp: 0xffff00012d2f7e60 lr: 0xffff0000005bf63c (rib_notify + 0x50) elr: 0xffffa0000c93bb00 spsr: 0x0000000060400045 far: 0xffffa0000c93bb00 esr: 0x000000008600000e panic: data abort in critical section or under mutex cpuid =3D 3 time =3D 1690047394 KDB: stack backtrace: db_trace_self() at db_trace_self db_trace_self_wrapper() at db_trace_self_wrapper+0x30 vpanic() at vpanic+0x13c panic() at panic+0x44 data_abort() at data_abort+0x30c handle_el1h_sync() at handle_el1h_sync+0x14 --- exception, esr 0x8600000e (null)() at 0xffffa0000c93bb00 add_route() at add_route+0xc4 add_route_flags() at add_route_flags+0x1b0 rib_add_route() at rib_add_route+0x324 ifa_maintain_loopback_route() at ifa_maintain_loopback_route+0xf4 in6_update_ifa() at in6_update_ifa+0x994 in6_ifattach() at in6_ifattach+0x1bc in6_if_up() at in6_if_up+0x90 if_up() at if_up+0xd8 ifhwioctl() at ifhwioctl+0xb7c ifioctl() at ifioctl+0x860 kern_ioctl() at kern_ioctl+0x2dc sys_ioctl() at sys_ioctl+0x118 do_el0_sync() at do_el0_sync+0x520 handle_el0_sync() at handle_el0_sync+0x44 --- exception, esr 0x56000000 It is happening for loopback interface IPv6 address.=20 A bug has been opened for the same https://bugs.freebsd.org/bugzilla/show_b= ug.cgi?id=3D272666 Can someone please help me here, to debug this issue. This is a blocker for FreeBSD on Azure ARM64. Thanks Souradeep=20