From owner-freebsd-stable@freebsd.org Fri Dec 28 10:07:43 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 3B17E1433831 for ; Fri, 28 Dec 2018 10:07:43 +0000 (UTC) (envelope-from jurij.kovacic@ocpea.com) Received: from mail-it1-x12d.google.com (mail-it1-x12d.google.com [IPv6:2607:f8b0:4864:20::12d]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id BA1EF835E7 for ; Fri, 28 Dec 2018 10:07:40 +0000 (UTC) (envelope-from jurij.kovacic@ocpea.com) Received: by mail-it1-x12d.google.com with SMTP id h65so26593741ith.3 for ; Fri, 28 Dec 2018 02:07:40 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to; bh=VJi1IjFtQrMp9El+pkkuWANl1eMW2MZczpJRmkvfO0U=; b=kXRvgsBbHKaQcmnJSGvtY88o7jGoZiSX2q5fmWqjqm1w7h7z6ljf9sxmtlK4dxephO xJe7Qz3c7TT5ISBMVMVqDHkEMM0yfLe5xpJf2TzUpGER/OZaHuuFLUexyhdx9SSbJn4O xes/7mB3wX3naVHKUrMHgVq+7aXWFXiJTlGMh1D5olgIelGYwvb76VBN5/G5oCPMLFE3 7dbsFsKa0qq5UITVnNEo11R6XUpe+1/+lBxO2xJsEwkBXt1REzAtlY93nusbfQJ7nz6e Egz1sZrbdyUKWakkbqTD0po4JnYG4x9xtSv33ls7adVpguT2aU0xQHs110UtIA6fmKMH EuSg== X-Gm-Message-State: AA+aEWbwvBu1SwvxMOhHklaJZqpO06z5uszX9Ov+4MWnIBjkryE70JHx YGt8/brvx+ERMaxkpFAtRM5DKV7PGz6wmUpOtExfe3Iv6hc= X-Google-Smtp-Source: AFSGD/V8/oW64kY5zzkgdvItFrLIreF3tASYJT1k2Xa1CmWNdd1CatQEotLBdi+rb9ZkkedOZRGvAh9SYElY9gjz0Uc= X-Received: by 2002:a02:1dc8:: with SMTP id 191mr17769176jaj.55.1545991659317; Fri, 28 Dec 2018 02:07:39 -0800 (PST) MIME-Version: 1.0 References: In-Reply-To: From: =?UTF-8?B?SnVyaWogS292YcSNacSN?= Date: Fri, 28 Dec 2018 11:07:27 +0100 Message-ID: Subject: Re: Kernel panic on 11.2-RELEASE-p7 To: freebsd-stable@freebsd.org X-Rspamd-Queue-Id: BA1EF835E7 X-Spamd-Bar: ----- X-Spamd-Result: default: False [-5.26 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[ocpea.com:s=google]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; TO_DN_NONE(0.00)[]; URI_COUNT_ODD(1.00)[5]; RCPT_COUNT_ONE(0.00)[1]; IP_SCORE(-2.27)[ip: (-7.88), ipnet: 2607:f8b0::/32(-1.87), asn: 15169(-1.51), country: US(-0.08)]; DKIM_TRACE(0.00)[ocpea.com:+]; MX_GOOD(-0.01)[alt1.aspmx.l.google.com,aspmx.l.google.com,alt3.aspmx.l.google.com,alt2.aspmx.l.google.com,alt4.aspmx.l.google.com]; RCVD_IN_DNSWL_NONE(0.00)[d.2.1.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; NEURAL_HAM_SHORT(-0.98)[-0.982,0]; DMARC_POLICY_ALLOW(-0.50)[ocpea.com,reject]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; RCVD_COUNT_TWO(0.00)[2] Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 28 Dec 2018 10:07:43 -0000 Dear list, This morning the server mentioned in my previous e-mail (Freebsd 11.2-RELEASE-p7 with GENERIC kernel, ZFS root) experienced another kernel panic: Fatal trap 9: general protection fault while in kernel mode cpuid =3D 0; apic id =3D 00 instruction pointer =3D 0x20:0xffffffff82299013 stack pointer =3D 0x28:0xfffffe0352893ad0 frame pointer =3D 0x28:0xfffffe0352893b10 code segment =3D base 0x0, limit 0xfffff, type 0x1b =3D DPL 0, pres 1, long 1, def32 0, gran 1 processor eflags =3D interrupt enabled, resume, IOPL =3D 0 current process =3D 9 (dbuf_evict_thread) trap number =3D 9 panic: general protection fault cpuid =3D 0 KDB: stack backtrace: #0 0xffffffff80b3d577 at kdb_backtrace+0x67 #1 0xffffffff80af6b17 at vpanic+0x177 #2 0xffffffff80af6993 at panic+0x43 #3 0xffffffff80f77fdf at trap_fatal+0x35f #4 0xffffffff80f7759e at trap+0x5e #5 0xffffffff80f5808c at calltrap+0x8 #6 0xffffffff8229c049 at dbuf_evict_one+0xe9 #7 0xffffffff82297a15 at dbuf_evict_thread+0x1a5 #8 0xffffffff80aba093 at fork_exit+0x83 #9 0xffffffff80f58fae at fork_trampoline+0xe I have used the "crashinfo" utility to (again) generate the text file which is available at this URL: http://www.ocpea.com/dump/core-2.txt Does anyone have any idea how we can go about discovering the cause for this? We would appreciate any suggestion ... Kind regards, Jurij Kovacic On Tue, Dec 25, 2018 at 7:57 AM Jurij Kova=C4=8Di=C4=8D wrote: > Dear list, > > I hope I am posting this to the correct list - if not, I apologize (and > please advise where to post this instead). > > Today I experienced a kernel panic on a (physical) server, running Freebs= d > 11.2-RELEASE-p7 with GENERIC kernel, ZFS root: > > Fatal trap 9: general protection fault while in kernel mode > cpuid =3D 0; apic id =3D 00 > instruction pointer =3D 0x20:0xffffffff82299013 > stack pointer =3D 0x28:0xfffffe0352893ad0 > frame pointer =3D 0x28:0xfffffe0352893b10 > code segment =3D base 0x0, limit 0xfffff, type 0x1b > =3D DPL 0, pres 1, long 1, def32 0, gran 1 > processor eflags =3D interrupt enabled, resume, IOPL =3D 0 > current process =3D 9 (dbuf_evict_thread) > trap number =3D 9 > panic: general protection fault > cpuid =3D 0 > KDB: stack backtrace: > #0 0xffffffff80b3d577 at kdb_backtrace+0x67 > #1 0xffffffff80af6b17 at vpanic+0x177 > #2 0xffffffff80af6993 at panic+0x43 > #3 0xffffffff80f77fdf at trap_fatal+0x35f > #4 0xffffffff80f7759e at trap+0x5e > #5 0xffffffff80f5808c at calltrap+0x8 > #6 0xffffffff8229c049 at dbuf_evict_one+0xe9 > #7 0xffffffff82297a15 at dbuf_evict_thread+0x1a5 > #8 0xffffffff80aba093 at fork_exit+0x83 > #9 0xffffffff80f58fae at fork_trampoline+0xe > > I have used "crashinfo" utility to generate the text file which is > available at this URL: http://www.ocpea.com/dump/core.txt > > At the time of the crash, the server was probably under more intensive I/= O > load (scheduled backup with rsync). > > This is a production server, so naturally, all advice is deeply > appreciated. :) > > Kind regards, > Jurij >