From owner-freebsd-stable@FreeBSD.ORG Tue Aug 7 19:22:31 2007 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 229EF16A418 for ; Tue, 7 Aug 2007 19:22:31 +0000 (UTC) (envelope-from mvh@ix.netcom.com) Received: from elasmtp-mealy.atl.sa.earthlink.net (elasmtp-mealy.atl.sa.earthlink.net [209.86.89.69]) by mx1.freebsd.org (Postfix) with ESMTP id CB9DC13C47E for ; Tue, 7 Aug 2007 19:22:30 +0000 (UTC) (envelope-from mvh@ix.netcom.com) DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=dk20050327; d=ix.netcom.com; b=E02zc0lG0sgkqpzCnH7l2F5jAHAjy+4JVkicyF3Qx6QXKgy6cmzEurltvEQkFuLy; h=X-Virus-Scanned:From:To:Subject:Message-Id:Date:X-ELNK-Trace:X-Originating-IP; Received: from [71.116.166.101] (helo=bsd.mvh) by elasmtp-mealy.atl.sa.earthlink.net with asmtp (Exim 4.34) id 1IIUQf-0001Ly-55 for freebsd-stable@freebsd.org; Tue, 07 Aug 2007 15:09:18 -0400 Received: from localhost (localhost [127.0.0.1]) by bsd.mvh (Postfix) with ESMTP id 8337B170B8 for ; Tue, 7 Aug 2007 12:09:16 -0700 (PDT) X-Virus-Scanned: amavisd-new at bsd.mvh Received: from bsd.mvh ([127.0.0.1]) by localhost (bsd.mvh [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id YC3eNbfT-v9t for ; Tue, 7 Aug 2007 12:09:11 -0700 (PDT) Received: by bsd.mvh (Postfix, from userid 1001) id DAC5017921; Tue, 7 Aug 2007 10:43:54 -0700 (PDT) From: Mike Harding To: freebsd-stable@freebsd.org Message-Id: <20070807174354.DAC5017921@bsd.mvh> Date: Tue, 7 Aug 2007 10:43:54 -0700 (PDT) X-ELNK-Trace: 2159e7a04884740af66dc3a06d5924d86e3ea12321d68e6d6d1d62a89d6a4777a7ce0e8f8d31aa3f350badd9bab72f9c350badd9bab72f9c350badd9bab72f9c X-Originating-IP: 71.116.166.101 Subject: Crash report X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 07 Aug 2007 19:22:31 -0000 I have had -lots- of panics since upgrading to 6.2 - my system was pretty much 100% before that. One thing I do have on my system is some jails, and I also see this crashes during tinderbox builds. I upgraded to 6.2-STABLE to see if the crashes were fixed, I still have them. Any ideas? memtest shows nothing wrong... - Mike H. bsd# kgdb kernel.debug /usr/crash/vmcore.3 kgdb: kvm_nlist(_stopped_cpus): kgdb: kvm_nlist(_stoppcbs): [GDB will not be able to debug user-mode threads: /usr/lib/libthread_db.so: Undefined symbol "ps_pglobal_lookup"] GNU gdb 6.1.1 [FreeBSD] Copyright 2004 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "i386-marcel-freebsd". Unread portion of the kernel message buffer: Fatal trap 12: page fault while in kernel mode fault virtual address = 0x0 fault code = supervisor read, page not present instruction pointer = 0x20:0xc065962a stack pointer = 0x28:0xe9a72a80 frame pointer = 0x28:0xe9a72a94 code segment = base 0x0, limit 0xfffff, type 0x1b = DPL 0, pres 1, def32 1, gran 1 processor eflags = interrupt enabled, resume, IOPL = 0 current process = 45 (bufdaemon) trap number = 12 panic: page fault Uptime: 1h57m10s Dumping 1022 MB (2 chunks) chunk 0: 1MB (159 pages) ... ok chunk 1: 1022MB (261600 pages) 1006 990 974 958 942 926 910 894 878 862 846 830 814 798 782 766 750 734 718 702 686 670 654 638 622 606 590 574 558 542 526 510 494 478 462 446 430 414 398 382 366 350 334 318 302 286 270 254 238 222 206 190 174 158 142 126 110 94 78 62 46 30 14 #0 doadump () at pcpu.h:165 165 __asm __volatile("movl %%fs:0,%0" : "=r" (td)); (kgdb) (kgdb) bt #0 doadump () at pcpu.h:165 #1 0xc0692b66 in boot (howto=260) at /usr/src/sys/kern/kern_shutdown.c:409 #2 0xc0692dfc in panic (fmt=0xc08e2397 "%s") at /usr/src/sys/kern/kern_shutdown.c:565 #3 0xc08847f4 in trap_fatal (frame=0xe9a72a40, eva=0) at /usr/src/sys/i386/i386/trap.c:837 #4 0xc088455b in trap_pfault (frame=0xe9a72a40, usermode=0, eva=0) at /usr/src/sys/i386/i386/trap.c:745 #5 0xc0884199 in trap (frame= {tf_fs = 8, tf_es = 40, tf_ds = 40, tf_edi = -981774848, tf_esi = 0, tf_ebp = -374920556, tf_isp = -374920596, tf_ebx = -948495924, tf_edx = 2048, tf_ecx = 0, tf_eax = 2, tf_trapno = 12, tf_err = 0, tf_eip = -1067084246, tf_cs = 32, tf_eflags = 66182, tf_esp = 2, tf_ss = -981470960}) at /usr/src/sys/i386/i386/trap.c:435 #6 0xc08718ca in calltrap () at /usr/src/sys/i386/i386/exception.s:139 #7 0xc065962a in g_io_request (bp=0xc77719cc, cp=0xc57b4e00) at /usr/src/sys/geom/geom_io.c:275 #8 0xc065bb81 in g_vfs_strategy (bo=0x2, bp=0xd938b618) at /usr/src/sys/geom/geom_vfs.c:107 #9 0xc07c67fd in ffs_geom_strategy (bo=0xc57ff1d0, bp=0xd938b618) at /usr/src/sys/ufs/ffs/ffs_vfsops.c:1805 #10 0xc07d26dd in ufs_strategy (ap=0x2) at /usr/src/sys/ufs/ufs/ufs_vnops.c:1973 #11 0xc0896549 in VOP_STRATEGY_APV (vop=0xc09ad260, a=0xe9a72b10) at vnode_if.c:1796 #12 0xc06ddb84 in bufstrategy (bo=0xc78cba50, bp=0x2) at vnode_if.h:928 #13 0xc06d86a0 in bufwrite (bp=0xd938b618) at buf.h:426 #14 0xc06da0bb in vfs_bio_awrite (bp=0xd938b618) at buf.h:410 #15 0xc06daf01 in flushbufqueues (flushdeps=0) at /usr/src/sys/kern/vfs_bio.c:2144 #16 0xc06daa03 in buf_daemon () at /usr/src/sys/kern/vfs_bio.c:2018 #17 0xc067cd50 in fork_exit (callout=0xc06da914 , arg=0x0, frame=0xe9a72d38) at /usr/src/sys/kern/kern_fork.c:830 #18 0xc087192c in fork_trampoline () at /usr/src/sys/i386/i386/exception.s:208 (kgdb) list *0xc065962a 0xc065962a is in g_io_request (/usr/src/sys/geom/geom_io.c:275). 270 KASSERT(bp->bio_length % cp->provider->sectorsize == 0, 271 ("wrong length %jd for sectorsize %u", 272 bp->bio_length, cp->provider->sectorsize)); 273 } 274 275 g_trace(G_T_BIO, "bio_request(%p) from %p(%s) to %p(%s) cmd %d", 276 bp, cp, cp->geom->name, pp, pp->name, bp->bio_cmd); 277 278 bp->bio_from = cp; 279 bp->bio_to = pp; (kgdb) 280 bp->bio_error = 0; 281 bp->bio_completed = 0; 282 283 KASSERT(!(bp->bio_flags & BIO_ONQUEUE), 284 ("Bio already on queue bp=%p", bp)); 285 bp->bio_flags |= BIO_ONQUEUE; 286 287 binuptime(&bp->bio_t0); 288 289 /* (kgdb) 290 * The statistics collection is lockless, as such, but we 291 * can not update one instance of the statistics from more 292 * than one thread at a time, so grab the lock first. 293 */ 294 g_bioq_lock(&g_bio_run_down); 295 if (g_collectstats & 1) 296 devstat_start_transaction(pp->stat, &bp->bio_t0); 297 if (g_collectstats & 2) 298 devstat_start_transaction(cp->stat, &bp->bio_t0); 299 (kgdb) bsd# dmesg Copyright (c) 1992-2007 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 6.2-STABLE #0: Mon Aug 6 10:10:57 PDT 2007 root@bsd.mvh:/usr/obj/usr/src/sys/M62 ACPI APIC Table: Timecounter "i8254" frequency 1193182 Hz quality 0 CPU: AMD Athlon(tm) 64 Processor 3700+ (2199.77-MHz 686-class CPU) Origin = "AuthenticAMD" Id = 0x20f71 Stepping = 1 Features=0x78bfbff Features2=0x1 AMD Features=0xe2500800 AMD Features2=0x1 real memory = 1072562176 (1022 MB) avail memory = 1032200192 (984 MB) ioapic0 irqs 0-23 on motherboard ioapic1 irqs 24-47 on motherboard kbd1 at kbdmux0 ath_hal: 0.9.20.3 (AR5210, AR5211, AR5212, RF5111, RF5112, RF2413, RF5413) acpi0: on motherboard acpi0: Power Button (fixed) Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x4008-0x400b on acpi0 cpu0: on acpi0 powernow0: on cpu0 acpi_button0: on acpi0 pcib0: port 0xcf8-0xcff on acpi0 pci0: on pcib0 agp0: mem 0xd0000000-0xd3ffffff at device 0.0 on pci0 pcib1: at device 1.0 on pci0 pci1: on pcib1 pcib2: irq 27 at device 2.0 on pci0 pci2: on pcib2 nvidia0: port 0xc000-0xc07f mem 0xc0000000-0xc0ffffff,0xb0000000-0xbfffffff,0xc1000000-0xc1ffffff irq 24 at device 0.0 on pci2 nvidia0: [GIANT-LOCKED] pcib3: irq 31 at device 3.0 on pci0 pci3: on pcib3 pcib4: irq 35 at device 3.1 on pci0 pci4: on pcib4 pcib5: irq 39 at device 3.2 on pci0 pci5: on pcib5 pcib6: irq 43 at device 3.3 on pci0 pci6: on pcib6 re0: port 0xd000-0xd0ff mem 0xd4040000-0xd40400ff irq 17 at device 6.0 on pci0 miibus0: on re0 rgephy0: on miibus0 rgephy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-FDX, auto re0: Ethernet address: 00:e0:4c:00:60:67 re0: [FAST] atapci0: port 0xe400-0xe47f,0xd400-0xd4ff mem 0xd4043000-0xd4043fff,0xd4000000-0xd401ffff irq 19 at device 7.0 on pci0 ata2: on atapci0 ata3: on atapci0 ata4: on atapci0 pcm0: port 0xdc00-0xdc1f,0xdd00-0xdd7f irq 17 at device 9.0 on pci0 pcm0: [GIANT-LOCKED] pcm0: system configuration SubVendorID: 0x1412, SubDeviceID: 0x3630 XIN2 Clock Source: 49.152MHz(192kHz*256) MPU-401 UART(s) #: not implemented ADC #: 1 DAC #: 4 Multi-track converter type: I2S(with volume, 192KHz support, 24bit resolution, ID#0x0) S/PDIF(IN/OUT): 0/1 ID# 0x00 GPIO(mask/dir/state): 0x3fff85/0x4000fa/0x72 fwohci0: port 0xde00-0xde7f mem 0xd4041000-0xd40417ff irq 18 at device 12.0 on pci0 fwohci0: OHCI version 1.10 (ROM=1) fwohci0: No. of Isochronous channels is 4. fwohci0: EUI64 00:11:06:66:00:1e:78:bb fwohci0: Phy 1394a available S400, 2 ports. fwohci0: Link S400, max_rec 2048 bytes. firewire0: on fwohci0 fwe0: on firewire0 if_fwe0: Fake Ethernet address: 02:11:06:1e:78:bb fwe0: Ethernet address: 02:11:06:1e:78:bb fwe0: if_start running deferred for Giant sbp0: on firewire0 fwohci0: Initiate bus reset fwohci0: BUS reset fwohci0: node_id=0xc800ffc0, gen=1, CYCLEMASTER mode firewire0: 1 nodes, maxhop <= 0, cable IRM = 0 (me) firewire0: bus manager 0 (me) atapci1: port 0xdf00-0xdf07,0xe000-0xe003,0xe100-0xe107,0xe200-0xe203,0xe300-0xe30f,0xd800-0xd8ff irq 20 at device 15.0 on pci0 ata5: on atapci1 ata6: on atapci1 atapci2: port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xe500-0xe50f at device 15.1 on pci0 ata0: on atapci2 ata1: on atapci2 uhci0: port 0xe600-0xe61f irq 21 at device 16.0 on pci0 uhci0: [GIANT-LOCKED] usb0: on uhci0 usb0: USB revision 1.0 uhub0: VIA UHCI root hub, class 9/0, rev 1.00/1.00, addr 1 uhub0: 2 ports with 2 removable, self powered uhci1: port 0xe700-0xe71f irq 21 at device 16.1 on pci0 uhci1: [GIANT-LOCKED] usb1: on uhci1 usb1: USB revision 1.0 uhub1: VIA UHCI root hub, class 9/0, rev 1.00/1.00, addr 1 uhub1: 2 ports with 2 removable, self powered uhci2: port 0xe800-0xe81f irq 21 at device 16.2 on pci0 uhci2: [GIANT-LOCKED] usb2: on uhci2 usb2: USB revision 1.0 uhub2: VIA UHCI root hub, class 9/0, rev 1.00/1.00, addr 1 uhub2: 2 ports with 2 removable, self powered uhci3: port 0xe900-0xe91f irq 21 at device 16.3 on pci0 uhci3: [GIANT-LOCKED] usb3: on uhci3 usb3: USB revision 1.0 uhub3: VIA UHCI root hub, class 9/0, rev 1.00/1.00, addr 1 uhub3: 2 ports with 2 removable, self powered ehci0: mem 0xd4042000-0xd40420ff irq 21 at device 16.4 on pci0 ehci0: [GIANT-LOCKED] usb4: EHCI version 1.0 usb4: companion controllers, 2 ports each: usb0 usb1 usb2 usb3 usb4: on ehci0 usb4: USB revision 2.0 uhub4: VIA EHCI root hub, class 9/0, rev 2.00/1.00, addr 1 uhub4: 8 ports with 8 removable, self powered isab0: at device 17.0 on pci0 isa0: on isab0 acpi_tz0: on acpi0 fdc0: port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on acpi0 fdc0: [FAST] fd0: <1440-KB 3.5" drive> on fdc0 drive 0 sio0: configured irq 4 not in bitmap of probed irqs 0 sio0: port may not be enabled sio0: <16550A-compatible COM port> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 sio0: type 16550A sio1: <16550A-compatible COM port> port 0x2f8-0x2ff irq 3 on acpi0 sio1: type 16550A ppc0: port 0x378-0x37f irq 7 on acpi0 ppc0: Generic chipset (NIBBLE-only) in COMPATIBLE mode ppbus0: on ppc0 plip0: on ppbus0 lpt0: on ppbus0 lpt0: Interrupt-driven port ppi0: on ppbus0 pmtimer0 on isa0 atkbdc0: at port 0x60,0x64 on isa0 atkbd0: irq 1 on atkbdc0 kbd0 at atkbd0 atkbd0: [GIANT-LOCKED] sc0: at flags 0x100 on isa0 sc0: VGA <16 virtual consoles, flags=0x300> vga0: at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0 ums0: Logitech USB RECEIVER, rev 1.10/25.10, addr 2, iclass 3/1 ums0: 16 buttons and Z dir. ukbd0: Chicony Saitek Eclipse Keyboard, rev 2.00/1.30, addr 3, iclass 3/1 kbd2 at ukbd0 uhid0: Chicony Saitek Eclipse Keyboard, rev 2.00/1.30, addr 3, iclass 3/1 ulpt0: HewLett Packard HP LaserJet 1200, rev 1.10/1.00, addr 2, iclass 7/1 ulpt0: using bi-directional mode Timecounter "TSC" frequency 2199771778 Hz quality 800 Timecounters tick every 1.000 msec acd0: DVDR at ata0-master UDMA33 ad10: 286168MB at ata5-master SATA150 cd0 at ata0 bus 0 target 0 lun 0 cd0: <_NEC DVD_RW ND-3520AW 3.06> Removable CD-ROM SCSI-0 device cd0: 33.000MB/s transfers cd0: cd present [90367 x 2048 byte records] Trying to mount root from ufs:/dev/ad10s2a WARNING: / was not properly dismounted WARNING: /tmp was not properly dismounted WARNING: /usr was not properly dismounted /usr: mount pending error: blocks 660 files 5 WARNING: /var was not properly dismounted bsd#