From owner-freebsd-net@freebsd.org Fri Oct 7 10:09:36 2016 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 91404BDE607 for ; Fri, 7 Oct 2016 10:09:36 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 7F533911 for ; Fri, 7 Oct 2016 10:09:36 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id u97A9a8S049163 for ; Fri, 7 Oct 2016 10:09:36 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-net@FreeBSD.org Subject: [Bug 148807] [panic] "panic: sbdrop" and "panic: sbsndptr: sockbuf _ and mbuf _ clashing" (8.1-RELEASE/10.1-STABLE/11-CURRENT) Date: Fri, 07 Oct 2016 10:09:36 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 10.1-STABLE X-Bugzilla-Keywords: crash, needs-qa, patch X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: emz@norma.perm.ru X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: freebsd-net@FreeBSD.org X-Bugzilla-Flags: mfc-stable9? mfc-stable10? mfc-stable11? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 07 Oct 2016 10:09:36 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D148807 --- Comment #30 from emz@norma.perm.ru --- Follow-up: RC3 was installed incorrectly (i.e. not installed at all). After proper RC3 downgrade (r305786) seems like server is at least more stable - = it runs for more than an hour. On 11.0-PRE (306739) panics were happening in l= ike 3 to 5 minutes. I have a handful of cores, in case someone needs them. As about the driver. This was a HP DL160 g6 I guess and the driver was igb(= 4). Now it's the Supermicro board (tech team switched the drives to a new chass= is to exclude possible hardware problems) and the ifconfig/dmesg.boot are as folows (the driver is still an igb(4)), and the dmesg is from 11-RC3: igb0: flags=3D8843 metric 0 mtu 1500 =20=20=20=20=20=20=20 options=3D6403bb ether 00:25:90:06:b7:9e nd6 options=3D29 media: Ethernet autoselect (1000baseT ) status: active igb1: flags=3D8c02 metric 0 mtu 1500 =20=20=20=20=20=20=20 options=3D6403bb ether 00:25:90:06:b7:9f nd6 options=3D29 media: Ethernet autoselect status: no carrier lo0: flags=3D8049 metric 0 mtu 16384 options=3D600003 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x3 inet 127.0.0.1 netmask 0xff000000 nd6 options=3D21 groups: lo vlan1: flags=3D8843 metric 0 mtu 15= 00 options=3D303 ether 00:25:90:06:b7:9e inet 192.168.0.248 netmask 0xffffff00 broadcast 192.168.0.255 nd6 options=3D29 media: Ethernet autoselect (1000baseT ) status: active vlan: 1 vlanpcp: 0 parent interface: igb0 groups: vlan vlan2: flags=3D8843 metric 0 mtu 15= 00 options=3D303 ether 00:25:90:06:b7:9e inet 91.206.242.1 netmask 0xfffffff0 broadcast 91.206.242.15 inet 91.206.242.5 netmask 0xfffffff0 broadcast 91.206.242.15 inet 91.206.242.8 netmask 0xfffffff0 broadcast 91.206.242.15 nd6 options=3D29 media: Ethernet autoselect (1000baseT ) status: active vlan: 2 vlanpcp: 0 parent interface: igb0 groups: vlan vlan3: flags=3D8843 metric 0 mtu 15= 00 options=3D303 ether 00:25:90:06:b7:9e inet 10.64.0.250 netmask 0xffffff00 broadcast 10.64.0.255 inet 10.64.0.252 netmask 0xffffff00 broadcast 10.64.0.255 nd6 options=3D29 media: Ethernet autoselect (1000baseT ) status: active vlan: 3 vlanpcp: 0 parent interface: igb0 groups: vlan vlan4: flags=3D8843 metric 0 mtu 15= 00 options=3D303 ether 00:25:90:06:b7:9e inet 89.250.210.6 netmask 0xfffffffc broadcast 89.250.210.7 nd6 options=3D29 media: Ethernet autoselect (1000baseT ) status: active vlan: 4 vlanpcp: 0 parent interface: igb0 groups: vlan vlan5: flags=3D8843 metric 0 mtu 15= 00 options=3D303 ether 00:25:90:06:b7:9e inet 77.43.142.201 netmask 0xfffffffc broadcast 77.43.142.203 nd6 options=3D29 media: Ethernet autoselect (1000baseT ) status: active vlan: 5 vlanpcp: 0 parent interface: igb0 groups: vlan vlan6: flags=3D8843 metric 0 mtu 15= 00 options=3D303 ether 00:25:90:06:b7:9e inet 172.20.142.250 netmask 0xffffff00 broadcast 172.20.142.255 nd6 options=3D29 media: Ethernet autoselect (1000baseT ) status: active vlan: 6 vlanpcp: 0 parent interface: igb0 groups: vlan vlan7: flags=3D8843 metric 0 mtu 15= 00 options=3D303 ether 00:25:90:06:b7:9e inet 172.16.240.2 netmask 0xffffff00 broadcast 172.16.240.255 nd6 options=3D29 media: Ethernet autoselect (1000baseT ) status: active vlan: 7 vlanpcp: 0 parent interface: igb0 groups: vlan vlan8: flags=3D8843 metric 0 mtu 15= 00 options=3D303 ether 00:25:90:06:b7:9e inet 86.109.196.74 netmask 0xfffffff8 broadcast 86.109.196.79 nd6 options=3D29 media: Ethernet autoselect (1000baseT ) status: active vlan: 8 vlanpcp: 0 parent interface: igb0 groups: vlan vlan9: flags=3D8843 metric 0 mtu 15= 00 options=3D303 ether 00:25:90:06:b7:9e inet 192.168.2.1 netmask 0xffffff00 broadcast 192.168.2.255 nd6 options=3D29 media: Ethernet autoselect (1000baseT ) status: active vlan: 9 vlanpcp: 0 parent interface: igb0 groups: vlan vlan10: flags=3D8843 metric 0 mtu 1= 500 options=3D303 ether 00:25:90:06:b7:9e inet 192.168.3.1 netmask 0xffffff00 broadcast 192.168.3.255 nd6 options=3D29 media: Ethernet autoselect (1000baseT ) status: active vlan: 10 vlanpcp: 0 parent interface: igb0 groups: vlan vlan11: flags=3D8843 metric 0 mtu 1= 500 options=3D303 ether 00:25:90:06:b7:9e inet 188.234.141.201 netmask 0xfffffffc broadcast 188.234.141.203 nd6 options=3D29 media: Ethernet autoselect (1000baseT ) status: active vlan: 11 vlanpcp: 0 parent interface: igb0 groups: vlan vlan12: flags=3D8843 metric 0 mtu 1= 500 options=3D303 ether 00:25:90:06:b7:9e inet 192.168.50.1 netmask 0xffffff00 broadcast 192.168.50.255 nd6 options=3D29 media: Ethernet autoselect (1000baseT ) status: active vlan: 12 vlanpcp: 0 parent interface: igb0 groups: vlan vlan13: flags=3D8843 metric 0 mtu 1= 500 options=3D303 ether 00:25:90:06:b7:9e inet 192.168.99.10 netmask 0xffffff00 broadcast 192.168.99.255 nd6 options=3D29 media: Ethernet autoselect (1000baseT ) status: active vlan: 13 vlanpcp: 0 parent interface: igb0 groups: vlan Dmesg: Copyright (c) 1992-2016 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 11.0-RC3 #0 r305786: Wed Sep 14 02:19:25 UTC 2016 root@releng2.nyi.freebsd.org:/usr/obj/usr/src/sys/GENERIC amd64 FreeBSD clang version 3.8.0 (tags/RELEASE_380/final 262564) (based on LLVM 3.8.0) VT(vga): resolution 640x480 CPU: Intel(R) Xeon(R) CPU E5620 @ 2.40GHz (2400.13-MHz K8-class = CPU) Origin=3D"GenuineIntel" Id=3D0x206c2 Family=3D0x6 Model=3D0x2c Steppi= ng=3D2 =20 Features=3D0xbfebfbff =20 Features2=3D0x9ee3fd AMD Features=3D0x2c100800 AMD Features2=3D0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID TSC: P-state invariant, performance statistics real memory =3D 51543801856 (49156 MB) avail memory =3D 49979412480 (47664 MB) Event timer "LAPIC" quality 600 ACPI APIC Table: <080312 APIC1521> FreeBSD/SMP: Multiprocessor System Detected: 16 CPUs FreeBSD/SMP: 2 package(s) x 4 core(s) x 2 hardware threads random: unblocking device. ACPI BIOS Warning (bug): 32/64X length mismatch in FADT/Gpe0Block: 128/64 (20160527/tbfadt-650) ioapic0: Changing APIC ID to 6 ioapic1: Changing APIC ID to 7 ioapic0 irqs 0-23 on motherboard ioapic1 irqs 24-47 on motherboard random: entropy device external interface kbd1 at kbdmux0 netmap: loaded module module_register_init: MOD_LOAD (vesa, 0xffffffff8101c950, 0) error 19 vtvga0: on motherboard cryptosoft0: on motherboard acpi0: on motherboard acpi0: Power Button (fixed) cpu0: on acpi0 cpu1: on acpi0 cpu2: on acpi0 cpu3: on acpi0 cpu4: on acpi0 cpu5: on acpi0 cpu6: on acpi0 cpu7: on acpi0 cpu8: on acpi0 cpu9: on acpi0 cpu10: on acpi0 cpu11: on acpi0 cpu12: on acpi0 cpu13: on acpi0 cpu14: on acpi0 cpu15: on acpi0 attimer0: port 0x40-0x43 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 atrtc0: port 0x70-0x71 irq 8 on acpi0 Event timer "RTC" frequency 32768 Hz quality 0 hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 950 Event timer "HPET" frequency 14318180 Hz quality 350 Event timer "HPET1" frequency 14318180 Hz quality 340 Event timer "HPET2" frequency 14318180 Hz quality 340 Event timer "HPET3" frequency 14318180 Hz quality 340 Timecounter "ACPI-safe" frequency 3579545 Hz quality 850 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x808-0x80b on acpi0 pcib0: port 0xcf8-0xcff numa-domain 0 on acpi0 pcib0: _OSC returned error 0x10 pci0: numa-domain 0 on pcib0 pcib1: at device 1.0 numa-domain 0 on pci0 pci1: numa-domain 0 on pcib1 igb0: port 0xec00-0xec1f mem 0xfbde0000-0xfbdfffff,0xfbdc0000-0xfbddffff,0xfbd9c000-0xfbd9ffff irq 28 at device 0.0 numa-domain 0 on pci1 igb0: Using MSIX interrupts with 9 vectors igb0: Ethernet address: 00:25:90:06:b7:9e igb0: Bound queue 0 to cpu 0 igb0: Bound queue 1 to cpu 1 igb0: Bound queue 2 to cpu 2 igb0: Bound queue 3 to cpu 3 igb0: Bound queue 4 to cpu 4 igb0: Bound queue 5 to cpu 5 igb0: Bound queue 6 to cpu 6 igb0: Bound queue 7 to cpu 7 igb0: netmap queues/slots: TX 8/1024, RX 8/1024 igb1: port 0xe880-0xe89f mem 0xfbd60000-0xfbd7ffff,0xfbd40000-0xfbd5ffff,0xfbd1c000-0xfbd1ffff irq 40 at device 0.1 numa-domain 0 on pci1 igb1: Using MSIX interrupts with 9 vectors igb1: Ethernet address: 00:25:90:06:b7:9f igb1: Bound queue 0 to cpu 8 igb1: Bound queue 1 to cpu 9 igb1: Bound queue 2 to cpu 10 igb1: Bound queue 3 to cpu 11 igb1: Bound queue 4 to cpu 12 igb1: Bound queue 5 to cpu 13 igb1: Bound queue 6 to cpu 14 igb1: Bound queue 7 to cpu 15 igb1: netmap queues/slots: TX 8/1024, RX 8/1024 pcib2: at device 3.0 numa-domain 0 on pci0 pci2: numa-domain 0 on pcib2 pcib3: at device 5.0 numa-domain 0 on pci0 pci3: numa-domain 0 on pcib3 pcib4: at device 7.0 numa-domain 0 on pci0 pci4: numa-domain 0 on pcib4 pcib5: at device 9.0 numa-domain 0 on pci0 pci5: numa-domain 0 on pcib5 pci0: at device 20.0 (no driver attached) pci0: at device 20.1 (no driver attached) pci0: at device 20.2 (no driver attached) pci0: at device 20.3 (no driver attached) uhci0: port 0xdc00-0xdc1f irq = 16 at device 26.0 numa-domain 0 on pci0 uhci0: LegSup =3D 0x2f00 usbus0 numa-domain 0 on uhci0 uhci1: port 0xd880-0xd89f irq = 21 at device 26.1 numa-domain 0 on pci0 uhci1: LegSup =3D 0x2f00 usbus1 numa-domain 0 on uhci1 uhci2: port 0xd800-0xd81f irq = 19 at device 26.2 numa-domain 0 on pci0 uhci2: LegSup =3D 0x2f00 usbus2 numa-domain 0 on uhci2 ehci0: mem 0xfbeda000-0xfbeda3ff irq 18 at device 26.7 numa-domain 0 on pci0 usbus3: EHCI version 1.0 usbus3 numa-domain 0 on ehci0 uhci3: port 0xd480-0xd49f irq = 23 at device 29.0 numa-domain 0 on pci0 uhci3: LegSup =3D 0x2f00 usbus4 numa-domain 0 on uhci3 uhci4: port 0xd400-0xd41f irq = 19 at device 29.1 numa-domain 0 on pci0 uhci4: LegSup =3D 0x2f00 usbus5 numa-domain 0 on uhci4 uhci5: port 0xd080-0xd09f irq = 18 at device 29.2 numa-domain 0 on pci0 uhci5: LegSup =3D 0x2f00 usbus6 numa-domain 0 on uhci5 ehci1: mem 0xfbed8000-0xfbed83ff irq 23 at device 29.7 numa-domain 0 on pci0 usbus7: EHCI version 1.0 usbus7 numa-domain 0 on ehci1 pcib6: at device 30.0 numa-domain 0 on pci0 pci6: numa-domain 0 on pcib6 vgapci0: mem 0xf9000000-0xf9ffffff,0xfaffc000-0xfaffffff,0xfb000000-0xfb7fffff irq 18 at device 1.0 numa-domain 0 on pci6 vgapci0: Boot video device isab0: at device 31.0 numa-domain 0 on pci0 isa0: numa-domain 0 on isab0 atapci0: port 0xd000-0xd007,0xcc00-0xcc03,0xc880-0xc887,0xc800-0xc803,0xc480-0xc48f,0xc40= 0-0xc40f irq 19 at device 31.2 numa-domain 0 on pci0 ata2: at channel 0 on atapci0 ata3: at channel 1 on atapci0 atapci1: port 0xc000-0xc007,0xbc00-0xbc03,0xb880-0xb887,0xb800-0xb803,0xb480-0xb48f,0xb40= 0-0xb40f irq 19 at device 31.5 numa-domain 0 on pci0 ata4: at channel 0 on atapci1 ata5: at channel 1 on atapci1 acpi_button0: on acpi0 atkbdc0: port 0x60,0x64 irq 1 on acpi0 atkbd0: irq 1 on atkbdc0 kbd0 at atkbd0 atkbd0: [GIANT-LOCKED] psm0: irq 12 on atkbdc0 psm0: [GIANT-LOCKED] psm0: model IntelliMouse Explorer, device ID 4 uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0 qpi0: on motherboard pcib7: pcibus 255 on qpi0 pci7: on pcib7 pcib8: pcibus 254 on qpi0 pci8: on pcib8 orm0: at iomem 0xc0000-0xc7fff,0xc8000-0xc8fff on isa0 ppc0: cannot reserve I/O port range est0: on cpu0 est1: on cpu1 est2: on cpu2 est3: on cpu3 est4: on cpu4 est5: on cpu5 est6: on cpu6 est7: on cpu7 est8: on cpu8 est9: on cpu9 est10: on cpu10 est11: on cpu11 est12: on cpu12 est13: on cpu13 est14: on cpu14 est15: on cpu15 ZFS filesystem version: 5 ZFS storage pool version: features support (5000) Timecounters tick every 1.000 msec nvme cam probe device init usbus0: 12Mbps Full Speed USB v1.0 usbus1: 12Mbps Full Speed USB v1.0 usbus2: 12Mbps Full Speed USB v1.0 ugen0.1: at usbus0 uhub0: on usbus0 ugen1.1: at usbus1 uhub1: on usbus1 ugen2.1: at usbus2 uhub2: on usbus2 usbus3: 480Mbps High Speed USB v2.0 usbus4: 12Mbps Full Speed USB v1.0 usbus5: 12Mbps Full Speed USB v1.0 ugen3.1: at usbus3 uhub3: on usbus3 ugen4.1: at usbus4 uhub4: on usbus4 ugen5.1: at usbus5 uhub5: on usbus5 usbus6: 12Mbps Full Speed USB v1.0 usbus7: 480Mbps High Speed USB v2.0 ugen6.1: at usbus6 uhub6: on usbus6 ugen7.1: at usbus7 uhub7: on usbus7 uhub2: 2 ports with 2 removable, self powered uhub1: 2 ports with 2 removable, self powered uhub0: 2 ports with 2 removable, self powered uhub6: 2 ports with 2 removable, self powered uhub4: 2 ports with 2 removable, self powered uhub5: 2 ports with 2 removable, self powered ada0 at ata2 bus 0 scbus0 target 0 lun 0 ada0: ATA-7 SATA 2.x device ada0: Serial Number WCASY6743897 ada0: 300.000MB/s transfers (SATA 2.x, UDMA5, PIO 8192bytes) ada0: 476940MB (976773168 512 byte sectors) ada1 at ata2 bus 0 scbus0 target 1 lun 0 ada1: ATA8-ACS SATA 3.x device ada1: Serial Number Z6EMAENR ada1: 300.000MB/s transfers (SATA 2.x, UDMA5, PIO 8192bytes) ada1: 476940MB (976773168 512 byte sectors) ada1: quirks=3D0x1<4K> ada2 at ata3 bus 0 scbus1 target 0 lun 0 ada2: ATA-7 SATA 2.x device ada2: Serial Number WCASY6752687 ada2: 300.000MB/s transfers (SATA 2.x, UDMA5, PIO 8192bytes) ada2: 476940MB (976773168 512 byte sectors) ada3 at ata3 bus 0 scbus1 target 1 lun 0 ada3: ATA8-ACS SATA 3.x device ada3: Serial Number Z6EM8QHK ada3: 300.000MB/s transfers (SATA 2.x, UDMA5, PIO 8192bytes) ada3: 476940MB (976773168 512 byte sectors) ada3: quirks=3D0x1<4K> SMP: AP CPU #1 Launched! SMP: AP CPU #15 Launched! SMP: AP CPU #4 Launched! SMP: AP CPU #10 Launched! SMP: AP CPU #6 Launched! SMP: AP CPU #11 Launched! SMP: AP CPU #2 Launched! SMP: AP CPU #8 Launched! SMP: AP CPU #3 Launched! SMP: AP CPU #12 Launched! SMP: AP CPU #7 Launched! SMP: AP CPU #13 Launched! SMP: AP CPU #5 Launched! SMP: AP CPU #9 Launched! SMP: AP CPU #14 Launched! Timecounter "TSC-low" frequency 1200065624 Hz quality 1000 Trying to mount root from zfs:zfsroot []... GEOM_MIRROR: Device mirror/swap launched (2/2). Root mount waiting for: usbus7 usbus3 Root mount waiting for: usbus7 usbus3 uhub7: 6 ports with 6 removable, self powered uhub3: 6 ports with 6 removable, self powered igb0: link state changed to UP vlan1: link state changed to UP vlan2: link state changed to UP vlan3: link state changed to UP vlan4: link state changed to UP vlan5: link state changed to UP vlan6: link state changed to UP vlan7: link state changed to UP vlan8: link state changed to UP vlan9: link state changed to UP vlan10: link state changed to UP vlan11: link state changed to UP vlan12: link state changed to UP vlan13: link state changed to UP --=20 You are receiving this mail because: You are the assignee for the bug.=