From owner-freebsd-bugs@FreeBSD.ORG Mon Apr 18 05:40:06 2011 Return-Path: Delivered-To: freebsd-bugs@hub.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 1EEF81065672 for ; Mon, 18 Apr 2011 05:40:06 +0000 (UTC) (envelope-from gnats@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:4f8:fff6::28]) by mx1.freebsd.org (Postfix) with ESMTP id EB2628FC13 for ; Mon, 18 Apr 2011 05:40:05 +0000 (UTC) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.4/8.14.4) with ESMTP id p3I5e5Rn090560 for ; Mon, 18 Apr 2011 05:40:05 GMT (envelope-from gnats@freefall.freebsd.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.4/8.14.4/Submit) id p3I5e55Y090559; Mon, 18 Apr 2011 05:40:05 GMT (envelope-from gnats) Resent-Date: Mon, 18 Apr 2011 05:40:05 GMT Resent-Message-Id: <201104180540.p3I5e55Y090559@freefall.freebsd.org> Resent-From: FreeBSD-gnats-submit@FreeBSD.org (GNATS Filer) Resent-To: freebsd-bugs@FreeBSD.org Resent-Reply-To: FreeBSD-gnats-submit@FreeBSD.org, Andrew Khlebutin Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 730D91065673 for ; Mon, 18 Apr 2011 05:34:06 +0000 (UTC) (envelope-from nobody@FreeBSD.org) Received: from red.freebsd.org (red.freebsd.org [IPv6:2001:4f8:fff6::22]) by mx1.freebsd.org (Postfix) with ESMTP id 5489F8FC12 for ; Mon, 18 Apr 2011 05:34:06 +0000 (UTC) Received: from red.freebsd.org (localhost [127.0.0.1]) by red.freebsd.org (8.14.4/8.14.4) with ESMTP id p3I5Y55C008575 for ; Mon, 18 Apr 2011 05:34:05 GMT (envelope-from nobody@red.freebsd.org) Received: (from nobody@localhost) by red.freebsd.org (8.14.4/8.14.4/Submit) id p3I5Y5Hp008574; Mon, 18 Apr 2011 05:34:05 GMT (envelope-from nobody) Message-Id: <201104180534.p3I5Y5Hp008574@red.freebsd.org> Date: Mon, 18 Apr 2011 05:34:05 GMT From: Andrew Khlebutin To: freebsd-gnats-submit@FreeBSD.org X-Send-Pr-Version: www-3.1 Cc: Subject: kern/156463: kernel panic at pcpu.h:224 X-BeenThere: freebsd-bugs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Bug reports List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 18 Apr 2011 05:40:06 -0000 >Number: 156463 >Category: kern >Synopsis: kernel panic at pcpu.h:224 >Confidential: no >Severity: serious >Priority: low >Responsible: freebsd-bugs >State: open >Quarter: >Keywords: >Date-Required: >Class: sw-bug >Submitter-Id: current-users >Arrival-Date: Mon Apr 18 05:40:05 UTC 2011 >Closed-Date: >Last-Modified: >Originator: Andrew Khlebutin >Release: 8.2 >Organization: JSC DartIT >Environment: FreeBSD venus.prm.ru 8.2-RELEASE FreeBSD 8.2-RELEASE #2: Mon Feb 21 19:58:13 YEKT 2011 root@venus.prm.ru:/usr/obj/usr/src/sys/venus amd64 >Description: The box panics and reboots ~ 2 times per month. https://venus.dartit.ru/tmp/core.6.txt https://venus.dartit.ru/tmp/info.6.txt https://venus.dartit.ru/tmp/vmcore.6.xz (402208K). venus.prm.ru dumped core - see /var/crash/vmcore.6 Mon Apr 18 09:50:21 YEKST 2011 FreeBSD venus.prm.ru 8.2-RELEASE FreeBSD 8.2-RELEASE #2: Mon Feb 21 19:58:13 YEKT 2011 root@venus.prm.ru:/usr/obj/usr/src/sys/venus amd64 panic: double fault GNU gdb 6.1.1 [FreeBSD] Copyright 2004 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "amd64-marcel-freebsd"... Unread portion of the kernel message buffer: Fatal double fault rip = 0xffffffff803abda4 rsp = 0xffffff800003df80 rbp = 0xffffff800003e0b0 cpuid = 0; apic id = 00 panic: double fault cpuid = 0 KDB: stack backtrace: #0 0xffffffff802e8cce at kdb_backtrace+0x5e #1 0xffffffff802b6387 at panic+0x187 #2 0xffffffff805295b6 at dblfault_handler+0x96 #3 0xffffffff8051230d at Xdblfault+0xad Uptime: 10m35s Physical memory: 4086 MB Dumping 658 MB: 643 627 611 595 579 563 547 531 515 499 483 467 451 435 419 403 387 371 355 339 323 307 291 275 259 243 227 211 195 179 163 147 131 115 99 83 67 51 35 19 3 Reading symbols from /boot/kernel/zfs.ko...Reading symbols from /boot/kernel/zfs.ko.symbols...done. done. Loaded symbols for /boot/kernel/zfs.ko Reading symbols from /boot/kernel/opensolaris.ko...Reading symbols from /boot/kernel/opensolaris.ko.symbols...done. done. Loaded symbols for /boot/kernel/opensolaris.ko Reading symbols from /boot/kernel/ng_pppoe.ko...Reading symbols from /boot/kernel/ng_pppoe.ko.symbols...done. done. Loaded symbols for /boot/kernel/ng_pppoe.ko Reading symbols from /boot/kernel/ng_tcpmss.ko...Reading symbols from /boot/kernel/ng_tcpmss.ko.symbols...done. done. Loaded symbols for /boot/kernel/ng_tcpmss.ko #0 doadump () at pcpu.h:224 224 pcpu.h: No such file or directory. in pcpu.h (kgdb) #0 doadump () at pcpu.h:224 #1 0xffffffff802b5f3e in boot (howto=260) at /usr/src/sys/kern/kern_shutdown.c:419 #2 0xffffffff802b6371 in panic (fmt=Variable "fmt" is not available.) at /usr/src/sys/kern/kern_shutdown.c:592 #3 0xffffffff805295b6 in dblfault_handler (frame=Variable "frame" is not available.) at /usr/src/sys/amd64/amd64/trap.c:810 #4 0xffffffff8051230d in Xdblfault () at /usr/src/sys/amd64/amd64/exception.S:280 #5 0xffffffff803abda4 in ipfw_chk (args=0xffffff800003e0e0) at /usr/src/sys/netinet/ipfw/ip_fw2.c:780 Previous frame inner to this frame (corrupt stack?) (kgdb) #cat /var/run/dmesg.boot Copyright (c) 1992-2011 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 8.2-RELEASE #2: Mon Feb 21 19:58:13 YEKT 2011 root@venus.prm.ru:/usr/obj/usr/src/sys/venus amd64 Timecounter "i8254" frequency 1193182 Hz quality 0 CPU: Intel(R) Core(TM)2 Duo CPU E8400 @ 3.00GHz (3002.67-MHz K8-class CPU) Origin = "GenuineIntel" Id = 0x1067a Family = 6 Model = 17 Stepping = 10 Features=0xbfebfbff Features2=0x408e3fd AMD Features=0x20100800 AMD Features2=0x1 TSC: P-state invariant real memory = 4294967296 (4096 MB) avail memory = 4121788416 (3930 MB) ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs FreeBSD/SMP: 1 package(s) x 2 core(s) cpu0 (BSP): APIC ID: 0 cpu1 (AP): APIC ID: 1 Security policy loaded: TrustedBSD MAC/BSD Extended (mac_bsdextended) Security policy loaded: TrustedBSD MAC/Partition (mac_partition) Security policy loaded: TrustedBSD MAC/portacl (mac_portacl) ioapic0: Changing APIC ID to 2 ioapic0 irqs 0-23 on motherboard kbd1 at kbdmux0 netsmb_dev: loaded cryptosoft0: on motherboard acpi0: on motherboard acpi0: [ITHREAD] acpi0: Power Button (fixed) acpi0: reservation of 0, a0000 (3) failed acpi0: reservation of 100000, efde0000 (3) failed Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0 cpu0: on acpi0 cpu1: on acpi0 acpi_button0: on acpi0 pcib0: port 0xcf8-0xcff on acpi0 pci0: on pcib0 pci0: at device 26.0 (no driver attached) pci0: at device 26.1 (no driver attached) pci0: at device 26.2 (no driver attached) ehci0: mem 0xf9205000-0xf92053ff irq 18 at device 26.7 on pci0 ehci0: [ITHREAD] usbus0: EHCI version 1.0 usbus0: on ehci0 pci0: at device 27.0 (no driver attached) pcib1: irq 16 at device 28.0 on pci0 pci1: on pcib1 pcib2: irq 19 at device 28.3 on pci0 pci2: on pcib2 pci2: at device 0.0 (no driver attached) pcib3: irq 16 at device 28.4 on pci0 pci3: on pcib3 re0: port 0xc000-0xc0ff mem 0xf9110000-0xf9110fff,0xf9100000-0xf910ffff irq 16 at device 0.0 on pci3 re0: Using 1 MSI messages re0: Chip rev. 0x3c000000 re0: MAC rev. 0x00400000 miibus0: on re0 rgephy0: PHY 1 on miibus0 rgephy0: 10baseT, 10baseT-FDX, 10baseT-FDX-flow, 100baseTX, 100baseTX-FDX, 100baseTX-FDX-flow, 1000baseT, 1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, 1000baseT-FDX-flow, 1000baseT-FDX-flow-master, auto, auto-flow re0: Ethernet address: 00:1f:d0:a2:12:0c re0: [FILTER] pcib4: irq 17 at device 28.5 on pci0 pci4: on pcib4 re1: port 0xd000-0xd0ff mem 0xf9010000-0xf9010fff,0xf9000000-0xf900ffff irq 17 at device 0.0 on pci4 re1: Using 1 MSI messages re1: Chip rev. 0x3c000000 re1: MAC rev. 0x00400000 miibus1: on re1 rgephy1: PHY 1 on miibus1 rgephy1: 10baseT, 10baseT-FDX, 10baseT-FDX-flow, 100baseTX, 100baseTX-FDX, 100baseTX-FDX-flow, 1000baseT, 1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, 1000baseT-FDX-flow, 1000baseT-FDX-flow-master, auto, auto-flow re1: Ethernet address: 00:1f:d0:a2:12:0e re1: [FILTER] pci0: at device 29.0 (no driver attached) pci0: at device 29.1 (no driver attached) pci0: at device 29.2 (no driver attached) ehci1: mem 0xf9204000-0xf92043ff irq 23 at device 29.7 on pci0 ehci1: [ITHREAD] usbus1: EHCI version 1.0 usbus1: on ehci1 pcib5: at device 30.0 on pci0 pci5: on pcib5 vgapci0: mem 0xf8000000-0xf87fffff irq 20 at device 0.0 on pci5 pci5: at device 7.0 (no driver attached) isab0: at device 31.0 on pci0 isa0: on isab0 ahci0: port 0xe600-0xe607,0xe700-0xe703,0xe800-0xe807,0xe900-0xe903,0xea00-0xea1f mem 0xf9206000-0xf92067ff irq 19 at device 31.2 on pci0 ahci0: [ITHREAD] ahci0: AHCI v1.20 with 6 3Gbps ports, Port Multiplier supported ahcich0: at channel 0 on ahci0 ahcich0: [ITHREAD] ahcich1: at channel 1 on ahci0 ahcich1: [ITHREAD] ahcich2: at channel 2 on ahci0 ahcich2: [ITHREAD] ahcich3: at channel 3 on ahci0 ahcich3: [ITHREAD] ahcich4: at channel 4 on ahci0 ahcich4: [ITHREAD] ahcich5: at channel 5 on ahci0 ahcich5: [ITHREAD] pci0: at device 31.3 (no driver attached) acpi_hpet0: iomem 0xfed00000-0xfed003ff irq 0,8 on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 900 atrtc0: port 0x70-0x73 on acpi0 uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 uart0: [FILTER] atkbdc0: port 0x60,0x64 irq 1 on acpi0 atkbd0: irq 1 on atkbdc0 kbd0 at atkbd0 atkbd0: [GIANT-LOCKED] atkbd0: [ITHREAD] orm0: at iomem 0xc0000-0xc7fff,0xc8000-0xc9fff on isa0 sc0: at flags 0x100 on isa0 sc0: VGA <16 virtual consoles, flags=0x300> vga0: at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0 coretemp0: on cpu0 est0: on cpu0 est: CPU supports Enhanced Speedstep, but is not recognized. est: cpu_vendor GenuineIntel, msr 616092206000922 device_attach: est0 attach returned 6 p4tcc0: on cpu0 coretemp1: on cpu1 est1: on cpu1 est: CPU supports Enhanced Speedstep, but is not recognized. est: cpu_vendor GenuineIntel, msr 616092206000922 device_attach: est1 attach returned 6 p4tcc1: on cpu1 Timecounters tick every 1.000 msec IPsec: Initialized Security Association Processing. ipfw2 initialized, divert enabled, nat enabled, rule-based forwarding enabled, default to deny, logging disabled usbus0: 480Mbps High Speed USB v2.0 usbus1: 480Mbps High Speed USB v2.0 ugen0.1: at usbus0 uhub0: on usbus0 ugen1.1: at usbus1 uhub1: on usbus1 ada0 at ahcich1 bus 0 scbus1 target 0 lun 0 ada0: ATA-8 SATA 2.x device ada0: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes) ada0: Command Queueing enabled ada0: 1430799MB (2930277168 512 byte sectors: 16H 63S/T 16383C) ada1 at ahcich2 bus 0 scbus2 target 0 lun 0 ada1: ATA-8 SATA 2.x device ada1: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes) ada1: Command Queueing enabled ada1: 305245MB (625142448 512 byte sectors: 16H 63S/T 16383C) SMP: AP CPU #1 Launched! Root mount waiting for: usbus1 usbus0 Root mount waiting for: usbus1 usbus0 uhub0: 6 ports with 6 removable, self powered Root mount waiting for: usbus1 uhub1: 6 ports with 6 removable, self powered Trying to mount root from ufs:/dev/label/rootfs WARNING: / was not properly dismounted ZFS NOTICE: Prefetch is disabled by default if less than 4GB of RAM is present; to enable, add "vfs.zfs.prefetch_disable=0" to /boot/loader.conf. ZFS filesystem version 4 ZFS storage pool version 15 WARNING: /data/backup was not properly dismounted lan: link state changed to UP re1: link state changed to UP vlan2: link state changed to UP vlan3: link state changed to UP vlan4: link state changed to UP >How-To-Repeat: >Fix: >Release-Note: >Audit-Trail: >Unformatted: