From owner-freebsd-bugs@freebsd.org Thu Oct 12 07:38:41 2017 Return-Path: Delivered-To: freebsd-bugs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 4BABAE46C15 for ; Thu, 12 Oct 2017 07:38:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 33E0A69FE7 for ; Thu, 12 Oct 2017 07:38:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v9C7cf50065593 for ; Thu, 12 Oct 2017 07:38:41 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-bugs@FreeBSD.org Subject: [Bug 222898] [iscsi]: panic: page fault - system crashes while working as iSCSI target Date: Thu, 12 Oct 2017 07:38:41 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.0-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: emz@norma.perm.ru X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-bugs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-bugs@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Bug reports List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 12 Oct 2017 07:38:41 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D222898 --- Comment #2 from emz@norma.perm.ru --- This very system, being boot up with debug kernel, built with crashes somewhere withing 30 seconds after the ctld is started: WARNING: 10.0.3.211 (iqn.1991-05.com.microsoft:worker379): no ping reply (NOP-Out) after 5 seconds; dropping connection WARNING: 10.0.3.211 (iqn.1991-05.com.microsoft:worker379): no ping reply (NOP-Out) after 5 seconds; dropping connection WARNING: 10.0.3.201 (iqn.1991-05.com.microsoft:worker369): no ping reply (NOP-Out) after 5 seconds; dropping connection WARNING: 213.152.134.47 (iqn.1991-05.com.microsoft:worker18): no ping reply (NOP-Out) after 5 seconds; dropping connecti on WARNING: 213.152.134.51 (iqn.1991-05.com.microsoft:worker22): no ping reply (NOP-Out) after 5 seconds; dropping connecti on WARNING: 10.0.3.219 (iqn.1991-05.com.microsoft:worker387): no ping reply (NOP-Out) after 5 seconds; dropping connection WARNING: 213.152.138.2 (iqn.2016-04.net.playkey.iscsi:esx11): no ping reply (NOP-Out) after 5 seconds; dropping connecti on panic: destroying session with 4 outstanding PDUs cpuid =3D 5 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe10555e4= 8f0 vpanic() at vpanic+0x186/frame 0xfffffe10555e4970 kassert_panic() at kassert_panic+0x126/frame 0xfffffe10555e49e0 icl_soft_conn_close() at icl_soft_conn_close+0x1f5/frame 0xfffffe10555e4a10 cfiscsi_maintenance_thread() at cfiscsi_maintenance_thread+0x100/frame 0xfffffe10555e4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe10555e4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe10555e4ab0 --- trap 0, rip =3D 0, rsp =3D 0, rbp =3D 0 --- Uptime: 2m11s Dumping 8422 out of 65386 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..= 91% Reading symbols from /boot/kernel/zfs.ko...Reading symbols from /usr/lib/debug//boot/kernel/zfs.ko.debug...done. done. Loaded symbols for /boot/kernel/zfs.ko Reading symbols from /boot/kernel/opensolaris.ko...Reading symbols from /usr/lib/debug//boot/kernel/opensolaris.ko.debug ...done. done. Loaded symbols for /boot/kernel/opensolaris.ko Reading symbols from /boot/kernel/geom_mirror.ko...Reading symbols from /usr/lib/debug//boot/kernel/geom_mirror.ko.debug ...done. done. Loaded symbols for /boot/kernel/geom_mirror.ko Reading symbols from /boot/kernel/pf.ko...Reading symbols from /usr/lib/debug//boot/kernel/pf.ko.debug...done. done. Loaded symbols for /boot/kernel/pf.ko Reading symbols from /boot/kernel/ichwd.ko...Reading symbols from /usr/lib/debug//boot/kernel/ichwd.ko.debug...done. done. Loaded symbols for /boot/kernel/ichwd.ko Reading symbols from /boot/kernel/ctl.ko...Reading symbols from /usr/lib/debug//boot/kernel/ctl.ko.debug...done. done. Loaded symbols for /boot/kernel/ctl.ko Reading symbols from /boot/kernel/iscsi.ko...Reading symbols from /usr/lib/debug//boot/kernel/iscsi.ko.debug...done. done. Loaded symbols for /boot/kernel/iscsi.ko #0 doadump (textdump=3D1) at pcpu.h:222 222 pcpu.h: No such file or directory. in pcpu.h (kgdb) #0 doadump (textdump=3D1) at pcpu.h:222 #1 0xffffffff80a2e725 in kern_reboot (howto=3D) at /usr/src-11-r310734/sys/kern/kern_shutdown.c:366 #2 0xffffffff80a2ed00 in vpanic (fmt=3D,=20 ap=3D) at /usr/src-11-r310734/sys/kern/kern_shutdown.c:759 #3 0xffffffff80a2eb36 in kassert_panic (fmt=3D) at /usr/src-11-r310734/sys/kern/kern_shutdown.c:649 #4 0xffffffff82875f05 in icl_soft_conn_close (ic=3D) at /usr/src-11-r310734/sys/modules/iscsi/../../dev/iscsi/icl_soft.c:1443 #5 0xffffffff82845560 in cfiscsi_maintenance_thread ( arg=3D) at icl_conn_if.h:135 #6 0xffffffff809f2064 in fork_exit ( callout=3D0xffffffff82845460 ,=20 arg=3D0xfffff8033e06cc00, frame=3D0xfffffe10555e4ac0) at /usr/src-11-r310734/sys/kern/kern_fork.c:1040 #7 0xffffffff80e7432e in fork_trampoline () at /usr/src-11-r310734/sys/amd64/amd64/exception.S:611 #8 0x0000000000000000 in ?? () Current language: auto; currently minimal (kgdb) This is reproducible, it crashed 3 times in a row from 3 attempts to run the debug kernel. I spoke with mav@, he told me (as far as I undertood) that wi= th is unintended behaviour, and it is probably the possible reason why the tar= get system crashes when running non-debug kernel. I collected a crashdump from one of the attempts, it's available here along with the kernel and modules binaries, along with non-stripped ones: http://files2.enaza.ru/ctld-stuck/debug/ --=20 You are receiving this mail because: You are the assignee for the bug.=