From nobody Tue Oct 12 18:39:55 2021 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 83E80180763F for ; Tue, 12 Oct 2021 18:40:06 +0000 (UTC) (envelope-from pen@lysator.liu.se) Received: from mail.lysator.liu.se (mail.lysator.liu.se [IPv6:2001:6b0:17:f0a0::3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4HTPbn1bsGz3tcG for ; Tue, 12 Oct 2021 18:40:05 +0000 (UTC) (envelope-from pen@lysator.liu.se) Received: from mail.lysator.liu.se (localhost [127.0.0.1]) by mail.lysator.liu.se (Postfix) with ESMTP id DB4D640004 for ; Tue, 12 Oct 2021 20:39:55 +0200 (CEST) Received: by mail.lysator.liu.se (Postfix, from userid 1004) id C87A640005; Tue, 12 Oct 2021 20:39:55 +0200 (CEST) X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on bernadotte.lysator.liu.se X-Spam-Level: X-Spam-Status: No, score=-0.9 required=5.0 tests=ALL_TRUSTED,AWL,HTML_MESSAGE autolearn=disabled version=3.4.2 X-Spam-Score: -0.9 Received: from smtpclient.apple (vpn-64.twilight.ifm.liu.se [130.236.167.64]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.lysator.liu.se (Postfix) with ESMTPSA id D198340004 for ; Tue, 12 Oct 2021 20:39:53 +0200 (CEST) From: Peter Eriksson Content-Type: multipart/alternative; boundary="Apple-Mail=_D3BCACE6-ED8F-48FE-A21A-AEE636A6A5EC" List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.120.0.1.13\)) Subject: Panic in pipe_write from syslogd in 12.2? Message-Id: <0FFAABE0-F260-4FE0-8B1D-1F179C502170@lysator.liu.se> Date: Tue, 12 Oct 2021 20:39:55 +0200 To: freebsd-current X-Mailer: Apple Mail (2.3654.120.0.1.13) X-Virus-Scanned: ClamAV using ClamSMTP X-Rspamd-Queue-Id: 4HTPbn1bsGz3tcG X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=pass (policy=none) header.from=liu.se; spf=pass (mx1.freebsd.org: domain of pen@lysator.liu.se designates 2001:6b0:17:f0a0::3 as permitted sender) smtp.mailfrom=pen@lysator.liu.se X-Spamd-Result: default: False [0.55 / 15.00]; RCVD_TLS_LAST(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; MV_CASE(0.50)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; NEURAL_HAM_LONG(-0.38)[-0.382]; NEURAL_SPAM_MEDIUM(0.93)[0.925]; RCPT_COUNT_ONE(0.00)[1]; RCVD_COUNT_THREE(0.00)[4]; TO_DN_ALL(0.00)[]; NEURAL_HAM_SHORT(-0.69)[-0.694]; DMARC_POLICY_ALLOW(-0.50)[liu.se,none]; R_SPF_ALLOW(-0.20)[+a:mail.lysator.liu.se]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:1653, ipnet:2001:6b0::/32, country:EU]; SUBJECT_ENDS_QUESTION(1.00)[]; MID_RHS_MATCH_FROM(0.00)[] X-ThisMailContainsUnwantedMimeParts: Y --Apple-Mail=_D3BCACE6-ED8F-48FE-A21A-AEE636A6A5EC Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 I just noticed that a couple of my 12.2-RELEASE-p4 running servers = have=E2=80=A6 8263, 14474 and 3831 defunct subprocesses from syslogd and = also seems to have stopped writing to the log files=E2=80=A6 When I = tried to kill syslogd on a fourth server (with some X000 defunct = processes) the machine panic=E2=80=99ed and rebooted. I seem to have a vague memory of this being a known bug/someone saw = something similar or perhaps even solved in later patch releases? But my = google-fu seems to be failing me today. Anyone else remember? (The one that panic=E2=80=99ed is now running -p10 instead which they = should have done a long time ago but=E2=80=A6) I reported it on the FreeBSD bugzilla: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D259084 = Output from one that still is running: # egrep syslogd /var/log/sys/15:10/procstat-kk-a.log 9212 101640 syslogd - mi_switch+0xd4 = sleepq_catch_signals+0x403 sleepq_wait_sig+0xf _sleep+0x1de = pipe_write+0x583 dofilewrite+0xb0 sys_write+0xc0 amd64_syscall+0x387 = fast_syscall_common+0xf8 Output from the one that panic=E2=80=99ed: Fatal trap 12: page fault while in kernel mode cpuid =3D 20; apic id =3D 14 fault virtual address =3D 0x410 fault code =3D supervisor read data, page not present instruction pointer =3D 0x20:0xffffffff80b9f55c stack pointer =3D 0x28:0xfffffe14debc6710 frame pointer =3D 0x28:0xfffffe14debc6790 code segment =3D base r = x0, limit 0xfffff, type 0x1b =3D DPL 0, pres 1, long 1, def32 0, gran 1 processor eflags =3D interrupt enabled, resume, IOPL =3D 0 current process =3D 9277 (sshd) trap number =3D 12 panic: page fault cpuid =3D 20 time =3D 1633990484 KDB: stack backtrace: #0 0xffffffff80c0ad75 at kdb_backtrace+0x65 #1 0xffffffff80bbf02b at vpanic+0x17b #2 0xffffffff80bbeea3 at panic+0x43 #3 0xffffffff8108e911 at trap_fatal+0x391 #4 0xffffffff8108e96f at trap_pfault+0x4f #5 0xffffffff8108dfb6 at trap+0x286 #6 0xffffffff81066c28 at calltrap+0x8 #7 0xffffffff80c6365f at unp_pcb_owned_lock2_slowpath+0x12f #8 0xffffffff80c61e0f at uipc_send+0x139f #9 0xffffffff80c55b7a at sosend_generic+0x4ca #10 0xffffffff80c55f90 at sosend+0x50 #11 0xffffffff80c5cc55 at kern_sendit+0x225 #12 0xffffffff80c5cfcc at sendit+0x19c #13 0xffffffff80c5ce1d at sys_sendto+0x4d #14 0xffffffff8108f4c7 at amd64_syscall+0x387 #15 0xffffffff8106754e at fast_syscall_common+0xf8 Uptime: 212d21h35m47s - Peter --Apple-Mail=_D3BCACE6-ED8F-48FE-A21A-AEE636A6A5EC--