From nobody Sun Jul 9 23:36:03 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Qzk6L3mXYzZT85 for ; Sun, 9 Jul 2023 23:36:10 +0000 (UTC) (envelope-from jfc@mit.edu) Received: from outgoing-exchange-5.mit.edu (outgoing-exchange-5.mit.edu [18.9.28.59]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.outgoing-exchange.mit.edu", Issuer "InCommon RSA Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Qzk6K6TtKz3rdq for ; Sun, 9 Jul 2023 23:36:09 +0000 (UTC) (envelope-from jfc@mit.edu) Authentication-Results: mx1.freebsd.org; none Received: from oc11exedge2.exchange.mit.edu (OC11EXEDGE2.EXCHANGE.MIT.EDU [18.9.3.18]) by outgoing-exchange-5.mit.edu (8.14.7/8.12.4) with ESMTP id 369Na7eO003411; Sun, 9 Jul 2023 19:36:07 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=mit.edu; s=outgoing; t=1688945768; bh=DQdRFeM9DHklZKapgKo70mJgwWkEFYm4qkSEJG0hg5Q=; h=From:To:CC:Subject:Date:References:In-Reply-To; b=Z0cF/wFwqolC6Socr5t0zVo2XwN4bZel64gQyB3iiK1VUFZd7ngIZp5eywjQ1rRwG 1G75vleWugvpS9QRR4FjMOBUb04Cy/9F5fsnbwcbgxHgJiukwjXm7BpqbOTVZGFhR/ VUZjncdC4b8ePiW8XMMoP1CGYmJt7rzuqXup19ztl1GeeGtQEfJIliEHRoxI8DkKLI yk6wW854gG2WwhtNxPmM2VJqv6QudXMGdFjyUgsH1T8RTAlel85NBL68rWucZWYYKw YaU0lnbHkyDvAER53m4i5BEZKGQnn7aZTYromDxaw7/gmnN0HsYyM72loHBZy/EM3F nzyqEhgGFIUag== Received: from w92expo16.exchange.mit.edu (18.7.74.70) by oc11exedge2.exchange.mit.edu (18.9.3.18) with Microsoft SMTP Server (TLS) id 15.0.1497.48; Sun, 9 Jul 2023 19:35:24 -0400 Received: from oc11exhyb2.exchange.mit.edu (18.9.1.98) by w92expo16.exchange.mit.edu (18.7.74.70) with Microsoft SMTP Server (TLS) id 15.0.1497.42; Sun, 9 Jul 2023 19:36:05 -0400 Received: from NAM10-DM6-obe.outbound.protection.outlook.com (104.47.58.100) by oc11exhyb2.exchange.mit.edu (18.9.1.98) with Microsoft SMTP Server (TLS) id 15.0.1497.48 via Frontend Transport; Sun, 9 Jul 2023 19:36:05 -0400 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=H8K2Axiq/vmLZvcRoBJpay72BhD4heItTgQ+B1ojhH7PSGQgquFlSR4d0eNJKAbZ/50C7bHsqyFmBNvkp4cjzNKitL9UgnhCNIB+4jhMAPjR9dOtJULEMZKHodi3wC6PpXtU7HV3hRQwwri5x8a5Npa4NgHRGhYIiKQi0yhwn1+84O/WT2DWc8uzN8cF1f4Hw2KhRHIptnYqwSGkYC32mGPi/3zjqCl2m11Q4EjGreUdoE1xf6bImMwzR/A/UrL3crlKhRMNKVpoN5dwwnvBF5bvZVWrqJLMcEfC0tTrKWNG01/DV/f1O2advXpvyR8WAtfqqltGY5tH+ZzKWp3u7g== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=DQdRFeM9DHklZKapgKo70mJgwWkEFYm4qkSEJG0hg5Q=; b=Q4eLvGtwq/uoN3cob1sf6e1aA1Am0yW7sLcBLmhvgOqoyQcq0RYDb58CaTRDqBXep/KASXnNy/mWZ69NppO4FXiVSNKvg45A2Ew7RRXkZzU8Glz/HRJdL04XPJv4MC/Ph+PiIG+e+KEnu1HjvRtxJwn/1oqWv/YRr8/8tmpU5kEVeTJ9lQ9XZcyEYF7NIbJnRW9Gg2Ef8GMjITWoueZxqpkJDHXyWnoCo32SU3BAPXNnddaMnVpEsIZi2B5651i8GYeEdbo64he2juI5vUVE6b6kWadPCv5r9rLCyzui22BaKhMOyIeAtgN8DDfO0trfhWMhCqqLILcfgcNQKNROJA== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=mit.edu; dmarc=pass action=none header.from=mit.edu; dkim=pass header.d=mit.edu; arc=none Received: from SA3PR01MB8450.prod.exchangelabs.com (2603:10b6:806:382::17) by SA1PR01MB6656.prod.exchangelabs.com (2603:10b6:806:1a0::13) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6565.30; Sun, 9 Jul 2023 23:36:03 +0000 Received: from SA3PR01MB8450.prod.exchangelabs.com ([fe80::19cc:d2bf:6e20:ea9e]) by SA3PR01MB8450.prod.exchangelabs.com ([fe80::19cc:d2bf:6e20:ea9e%5]) with mapi id 15.20.6565.028; Sun, 9 Jul 2023 23:36:03 +0000 From: John F Carr To: Konstantin Belousov CC: Current FreeBSD Subject: Re: shell hung in fork system call Thread-Topic: shell hung in fork system call Thread-Index: AQHZsrZ/ESS/lm7aiEed00HTHSgdc6+yE+cAgAAC3gA= Date: Sun, 9 Jul 2023 23:36:03 +0000 Message-ID: <52A8F775-17D9-4240-A444-98AD5339622F@mit.edu> References: <909E2C96-3BFA-41AD-8EE7-0902231C2B95@mit.edu> In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-ms-publictraffictype: Email x-ms-traffictypediagnostic: SA3PR01MB8450:EE_|SA1PR01MB6656:EE_ x-ms-office365-filtering-correlation-id: dfa4a620-89f7-4160-cba8-08db80d5423e x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: RXWSDqKHnILtAgX3YkYdBh6UzPVLUW247pjzJGzP6hKQc2s2Y0W+8P5yuzyXW2PqhPTLRKOCKdIeV+A8JNsmK2hSkz6vk6ELytdfJTiaNbuwjpuFxQ5WNLruCNoWUOb0PmJJqoORPl0+hK6FLcQjARIP7Ch1eLaE8zlnlYdpksj6yvoleZpMsZYkGjVICoiCrgAmfPoFWPvAX6jvYVGp+/ick3oRrSJn669+SkUYjocKSPXljoi3fHSDXiRTc0NzaZSLa4JOTrGmLEXzYhZU2Os/IlHZ0HeTdsVhcpm3NWzX01PRpW++gvNFZ7ITNnJ1x6vSox2xOZrq4gPs5MmqlYOKJwc+Nc6vPfQo3rIIoDosgmIbMaP1m3J47io4am4txyeST9GnyfiC3TGGKBC6uh67aYFElWFqZx+snAVJTaQdDI0WjyB3hRGoRum6bLR6acbbO1FV0wbtzCN8nd6H12pdY2TzioLnqOzWfgBfqpzQfSUBOT4pgmZAe3Rh6p9lb+bv01+ppr5VQ76CM7wX5VotkUzeZRQnsSZmVR4IaRSZ+CGud6XdS6WnsFffJ4200NqRwUQlzIxXKehh0q1uagT7t9ocxCJ69RfEMXTcS7U= x-forefront-antispam-report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:SA3PR01MB8450.prod.exchangelabs.com;PTR:;CAT:NONE;SFS:(13230028)(4636009)(376002)(39860400002)(346002)(136003)(396003)(366004)(451199021)(75432002)(186003)(6506007)(53546011)(26005)(2616005)(6512007)(83380400001)(41300700001)(4326008)(6916009)(64756008)(66446008)(2906002)(66556008)(316002)(786003)(8676002)(8936002)(66476007)(5660300002)(478600001)(66946007)(6486002)(76116006)(91956017)(71200400001)(33656002)(36756003)(122000001)(86362001)(38100700002)(38070700005);DIR:OUT;SFP:1102; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?us-ascii?Q?0c2bltG+GJFpwCqquBwHygvFvUh85upfqTtkOLXcP9omd8mgK5nhCUHLr8k9?= =?us-ascii?Q?Mq1LK/GAFC/aV9yODXEHZq7IvraWIIUkzMlDbEQmHsvWNSyI6NP+S0vofxxL?= =?us-ascii?Q?A0Wsz2uWnpE6Mt/dnAjlqWDCZTTt3zHooov9a9UISyXhc2b1y4wh02CyzG82?= =?us-ascii?Q?HkaevRH/ImJhJMYhjwns84cbxRCABV/9T+l/97lGnpJpdnZhwlWMrWtbeeXz?= =?us-ascii?Q?eWqMyM+1gsEPcPwnBKWf5AWjXCgLfdf90xkAvYarwugyK3j50IB2s7DcxlmO?= =?us-ascii?Q?fD7PbZ/sCKVGIQpwGibfbtbkgKSLAhO00filISx+ru/T+WR/JkMMWLJ5JYf6?= =?us-ascii?Q?XSaLGetCHl2cNkkMYJsYxnZ4Pqt7iZSq+jjrNdJBdaU6ZQeuuI5oUntebkU3?= =?us-ascii?Q?kafE+t1fveymOdExPtNaI1USN7r4Ah4XGYt2UFjm8g/vj9TpJkVIaitYLdVq?= =?us-ascii?Q?Btqi04W34rYtgjkoMbGH7zLAE36+YyuIU2saB52CtDm/RVXwI9Sri9I7asf6?= =?us-ascii?Q?JOCv30OGoSYNXiWS3C0DSGCHwcOOznIljYoRjR9jSeq4TU9meh0jz1Jg3IQU?= =?us-ascii?Q?qmdInG7WVZ4EG7E5Wjbyheir+wsR6ThYoVORYE0xkMm6RBqmkA9BM0i1UUTR?= =?us-ascii?Q?TDhjC2ijZlp67wEIBM8skPvaL/lCFNsEv5CYrP/KDtw6p9FVNcixCJCftfEY?= =?us-ascii?Q?I4ZFP+URtdGEN3mu5PuMV6ubDm5RvUjqRoyTNQ6TuZPlyVfPsuV7exS2M3eV?= =?us-ascii?Q?vDQVfUv1BoLjMzLoCRlVlUNwyv4OU14y5TO7SnL2e3sjd+Tz7k+JjcfiSkzW?= =?us-ascii?Q?+DB5i4tXm/W2Vdffr6dIvluA5pOiETXDkSGXHsLfl8Q8mSL8I6HzsyIKCXbu?= =?us-ascii?Q?5QmWUjhQLZdYYbwFyHiUR6IZhNM87TzX5N/ZAERmq4+uk1KgzbTznFlJJwwz?= =?us-ascii?Q?JuZLPbvNzSwc5cMM5cuOZ1ucsxMkpmU8X8Bs4D+AO+ZYbfAN4BX9EfAX8urX?= =?us-ascii?Q?Vs5F7KMGoVNl5UuD8ZvWWjwzNxikK71i3taGLQH5lpnF+IER0Wuh+jbuB5+t?= =?us-ascii?Q?mI4QmGdlAoMoYLWkxMX9gBp9Xpzbh3n8R+ECg+fdFYM3GG+zuE/7FRvx8Aqx?= =?us-ascii?Q?0t2BpqYF3XvVSmURoneiOD5kOGPGmL2qCWKNAXqRQEFTRsRZYm3qHfpwNq1U?= =?us-ascii?Q?0/JuHIt4ER+NjO8DcTmWcVLxEgML6qb5F00rfkQwgCAe+EnfE3WObWE9/S13?= =?us-ascii?Q?ipNa8hEc3BVRPWLShqqmTeU7SQ41Cx+9OYqO52IB11XmCWgxKv5rLADxL083?= =?us-ascii?Q?7iVNRT2dikBp2kNoLajyOa4xyEVGvqKDalj7jjqc9+lBSwQDwToNMRObqw8y?= =?us-ascii?Q?nqkIQXRjZt0rFbQVTF1HuKeI3cX/L0tR52Z1XHO79kcHzDLaOjN1Hq2W9mCv?= =?us-ascii?Q?+DID2FREgVCgkJmvq+yokAMztINKdKp/onlj5dHN17vLZRoXueUi2wFgWSgc?= =?us-ascii?Q?g/g++Wl2+Q2emmHSTNUPfwgMHKExmtTYif0sgvnInYzaRHzTJPYd2k8oy5nN?= =?us-ascii?Q?DLKJjmWp+R4NsRdmKdQ=3D?= Content-Type: text/plain; charset="us-ascii" Content-ID: <3280F93B86616C4994FC489CB7F03196@prod.exchangelabs.com> Content-Transfer-Encoding: quoted-printable List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: SA3PR01MB8450.prod.exchangelabs.com X-MS-Exchange-CrossTenant-Network-Message-Id: dfa4a620-89f7-4160-cba8-08db80d5423e X-MS-Exchange-CrossTenant-originalarrivaltime: 09 Jul 2023 23:36:03.0448 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 64afd9ba-0ecf-4acf-bc36-935f6235ba8b X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: JhDsfM/kloqCWfCDA9a1lNEWjf+gkjuAzV/ezy3wZCu9kIC/zjG9ZxWotwmwDWD6 X-MS-Exchange-Transport-CrossTenantHeadersStamped: SA1PR01MB6656 X-OriginatorOrg: mit.edu X-Rspamd-Queue-Id: 4Qzk6K6TtKz3rdq X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:3, ipnet:18.9.0.0/16, country:US] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N > On Jul 9, 2023, at 19:25, Konstantin Belousov wrote= : >=20 > On Sun, Jul 09, 2023 at 10:41:27PM +0000, John F Carr wrote: >> Kernel and system at a146207d66f320ed239c1059de9df854b66b55b7 plus some = irrelevant local changes, four 64 bit ARM processors, make.conf sets CPUTYP= E?=3Dcortex-a57. >>=20 >> I typed ^C while /bin/sh was starting a pipeline and my shell got hung i= n the middle of fork(). >>=20 >>> From the terminal: >>=20 >> # git log --oneline --|more >> ^C^C^C >> load: 3.26 cmd: sh 95505 [fork] 5308.67r 0.00u 0.03s 0% 2860k >> mi_switch+0x198 sleepq_switch+0xfc sleepq_timedwait+0x40 _sleep+0x264 fo= rk1+0x67c sys_fork+0x34 do_el0_sync+0x4c8 handle_el0_sync+0x44=20 >> load: 3.16 cmd: sh 95505 [fork] 5311.75r 0.00u 0.03s 0% 2860k >> mi_switch+0x198 sleepq_switch+0xfc sleepq_timedwait+0x40 _sleep+0x264 fo= rk1+0x67c sys_fork+0x34 do_el0_sync+0x4c8 handle_el0_sync+0x44=20 >>=20 >> According to ps -d on another terminal the shell has no children: >>=20 >> PID TT STAT TIME COMMAND >> [...] >> 873 u0 IWs 0:00.00 `-- login [pam] (login) >> 874 u0 I 0:00.17 `-- -sh (sh) >> 95504 u0 I 0:00.01 `-- su - >> 95505 u0 D+ 0:00.05 `-- -su (sh) >> [...] >>=20 >> Nothing on the (115200 bps serial) console. No change in system perform= ance. >>=20 >> The system is busy copying a large amount of data from the network to a = ZFS pool on spinning disks. The git|more pipeline could have taken some ti= me to get going while I/O requests worked their way through the queue. It = would not have touched the busy pool, only the zroot pool on an SSD. >>=20 >> Has anything changed recently that might cause this? >=20 > There was some change around fork, but your sleep seems to be not from > that change. Can you show the wait channel for the process? Do somethin= g > like > $ ps alxww >=20 UID PID PPID C PRI NI VSZ RSS MWCHAN STAT TT TIME COMMAND 0 95505 95504 2 20 0 13508 2876 fork D+ u0 0:00.13 -su (sh= ) This is probably the same information displayed as [fork] in the output fro= m ^T. Does it correspond to the source line pause("fork", hz / 2); ?