From owner-freebsd-stable@freebsd.org Thu Oct 27 10:01:36 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 5C520C23DB3 for ; Thu, 27 Oct 2016 10:01:36 +0000 (UTC) (envelope-from emz@norma.perm.ru) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 46CAABF5 for ; Thu, 27 Oct 2016 10:01:36 +0000 (UTC) (envelope-from emz@norma.perm.ru) Received: by mailman.ysv.freebsd.org (Postfix) id 4629AC23DB2; Thu, 27 Oct 2016 10:01:36 +0000 (UTC) Delivered-To: stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 45C4FC23DB1 for ; Thu, 27 Oct 2016 10:01:36 +0000 (UTC) (envelope-from emz@norma.perm.ru) Received: from elf.hq.norma.perm.ru (mail.norma.perm.ru [IPv6:2a00:7540:1::5]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.norma.perm.ru", Issuer "Vivat-Trade UNIX Root CA" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id A4DF8BF3 for ; Thu, 27 Oct 2016 10:01:35 +0000 (UTC) (envelope-from emz@norma.perm.ru) Received: from bsdrookie.norma.com. ([IPv6:fd00::73d]) by elf.hq.norma.perm.ru (8.15.2/8.15.2) with ESMTPS id u9RA1ULR039587 (version=TLSv1.2 cipher=DHE-RSA-AES128-SHA bits=128 verify=NO) for ; Thu, 27 Oct 2016 15:01:31 +0500 (YEKT) (envelope-from emz@norma.perm.ru) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=norma.perm.ru; s=key; t=1477562491; bh=6t8YW41y1kXVVOyERt352rvISStzoXzyha6Gf1vuqXo=; h=To:From:Subject:Date; b=W0dmWyNlLF3sXdjr8X8FP0b5IuMqzSho06EsFfXHIAWcVUlz/EZLKJRU/bP11s4oX bJz6P/zNKl+sP4tcprllDaxGeoCrd3IvnJlGNgzzpRnnkNznt2oI62hKaxCwU/8KCf zfqlVLVCdLZiyIi8343Z/od7ywjYQQnsStaxV4ME= To: "stable@freebsd.org" From: "Eugene M. Zheganin" Subject: 11.0-RELEASE-p2: panic: vm_page_unwire: page 0x[...]'s wire count is zero Message-ID: <5811D07A.9050409@norma.perm.ru> Date: Thu, 27 Oct 2016 15:01:30 +0500 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:38.0) Gecko/20100101 Thunderbird/38.7.0 MIME-Version: 1.0 Content-Type: text/plain; charset=koi8-r Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 27 Oct 2016 10:01:36 -0000 Hi, I've upgraded one of my old FreeBSD from 10-STABLE (which was leaking the wired memory and this was fixed in the spring; other than that it was pretty much stable) to the 11.0-RELEASE-p2, and almost immidiately got myself a panic: ===Cut=== # more core.txt.0 calypso.enaza.ru dumped core - see /var/crash/vmcore.0 Thu Oct 27 14:47:50 YEKT 2016 FreeBSD calypso.enaza.ru 11.0-RELEASE-p2 FreeBSD 11.0-RELEASE-p2 #0 r307991: Thu Oct 27 13:41:31 YEKT 2016 emz@calypso.enaza.ru:/usr/obj/usr/src/sys/CALYPSO amd64 panic: vm_page_unwire: page 0xfffff8023ca8b2f8's wire count is zero GNU gdb 6.1.1 [FreeBSD] Copyright 2004 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "amd64-marcel-freebsd"... Unread portion of the kernel message buffer: panic: vm_page_unwire: page 0xfffff8023ca8b2f8's wire count is zero cpuid = 3 KDB: stack backtrace: #0 0xffffffff80b1b417 at kdb_backtrace+0x67 #1 0xffffffff80ad0782 at vpanic+0x182 #2 0xffffffff80ad05f3 at panic+0x43 #3 0xffffffff80e693b3 at vm_page_unwire+0x73 #4 0xffffffff80accb40 at sf_ext_free+0xb0 #5 0xffffffff80aa7ad0 at mb_free_ext+0xc0 #6 0xffffffff80aa81a8 at m_freem+0x38 #7 0xffffffff80cf7453 at tcp_do_segment+0x28a3 #8 0xffffffff80cf3edc at tcp_input+0xd1c #9 0xffffffff80c64c5f at ip_input+0x15f #10 0xffffffff80bfa135 at netisr_dispatch_src+0xa5 #11 0xffffffff80be2b9a at ether_demux+0x12a #12 0xffffffff80be37f2 at ether_nh_input+0x322 #13 0xffffffff80bfa135 at netisr_dispatch_src+0xa5 #14 0xffffffff80be2e16 at ether_input+0x26 #15 0xffffffff8055983c at igb_rxeof+0x81c #16 0xffffffff80558b92 at igb_msix_que+0x152 #17 0xffffffff80a8a7af at intr_event_execute_handlers+0x20f Uptime: 28m25s Dumping 3780 out of 8147 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91% Reading symbols from /boot/kernel/zfs.ko...Reading symbols from /usr/lib/debug//boot/kernel/zfs.ko.debug...done. done. Loaded symbols for /boot/kernel/zfs.ko Reading symbols from /boot/kernel/opensolaris.ko...Reading symbols from /usr/lib/debug//boot/kernel/opensolaris.ko.debug...done. done. Loaded symbols for /boot/kernel/opensolaris.ko #0 doadump (textdump=) at pcpu.h:221 221 pcpu.h: No such file or directory. in pcpu.h (kgdb) #0 doadump (textdump=) at pcpu.h:221 #1 0xffffffff80ad0209 in kern_reboot (howto=260) at /usr/src/sys/kern/kern_shutdown.c:366 #2 0xffffffff80ad07bb in vpanic (fmt=, ap=) at /usr/src/sys/kern/kern_shutdown.c:759 #3 0xffffffff80ad05f3 in panic (fmt=0x0) at /usr/src/sys/kern/kern_shutdown.c:690 #4 0xffffffff80e693b3 in vm_page_unwire (m=, queue=) at /usr/src/sys/vm/vm_page.c:3136 #5 0xffffffff80accb40 in sf_ext_free (arg1=0xfffff8023ca8b2f8, arg2=0x0) at /usr/src/sys/kern/kern_sendfile.c:140 #6 0xffffffff80aa7ad0 in mb_free_ext (m=0xfffff80022f27c00) at /usr/src/sys/kern/kern_mbuf.c:678 #7 0xffffffff80aa81a8 in m_freem (mb=) at mbuf.h:1180 #8 0xffffffff80cf7453 in tcp_do_segment (m=, th=, so=0xfffff80022ba6a20, tp=, drop_hdrlen=52, tlen=, iptos=, ti_locked=Cannot access memory at address 0x1 ) at /usr/src/sys/netinet/tcp_input.c:1764 #9 0xffffffff80cf3edc in tcp_input (mp=, offp=, proto=) at /usr/src/sys/netinet/tcp_input.c:1442 #10 0xffffffff80c64c5f in ip_input (m=Cannot access memory at address 0x0 ) at /usr/src/sys/netinet/ip_input.c:809 #11 0xffffffff80bfa135 in netisr_dispatch_src (proto=1, source=, m=0x0) at /usr/src/sys/net/netisr.c:1121 #12 0xffffffff80be2b9a in ether_demux (ifp=, m=0x0) at /usr/src/sys/net/if_ethersubr.c:850 #13 0xffffffff80be37f2 in ether_nh_input (m=) at /usr/src/sys/net/if_ethersubr.c:639 #14 0xffffffff80bfa135 in netisr_dispatch_src (proto=5, source=, m=0x0) at /usr/src/sys/net/netisr.c:1121 #15 0xffffffff80be2e16 in ether_input (ifp=, m=0x0) at /usr/src/sys/net/if_ethersubr.c:759 #16 0xffffffff8055983c in igb_rxeof (count=583080448) at /usr/src/sys/dev/e1000/if_igb.c:4957 #17 0xffffffff80558b92 in igb_msix_que (arg=0xfffff8000649b538) at /usr/src/sys/dev/e1000/if_igb.c:1612 #18 0xffffffff80a8a7af in intr_event_execute_handlers ( p=, ie=) at /usr/src/sys/kern/kern_intr.c:1262 #19 0xffffffff80a8aa16 in ithread_loop (arg=) at /usr/src/sys/kern/kern_intr.c:1275 #20 0xffffffff80a873f5 in fork_exit ( callout=0xffffffff80a8a950 , arg=0xfffff80006497900, frame=0xfffffe01f0b1cc00) at /usr/src/sys/kern/kern_fork.c:1038 #21 0xffffffff80fc112e in fork_trampoline () at /usr/src/sys/amd64/amd64/exception.S:611 #22 0x0000000000000000 in ?? () Current language: auto; currently minimal (kgdb) ===Cut=== Has anyone seen this, and what are my actions ? I've google a bit, saw some references mentioning FreeBSD 9.x and ZERO_COPY_SOCKETS, but I don't have neither, so now I'm trying to understand what will my actions be.... do I report this ? Thanks. Eugene.