From owner-freebsd-current@FreeBSD.ORG Tue Apr 12 21:12:43 2005 Return-Path: Delivered-To: freebsd-current@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id E664D16A4CE for ; Tue, 12 Apr 2005 21:12:43 +0000 (GMT) Received: from pne-smtpout2-sn2.hy.skanova.net (pne-smtpout2-sn2.hy.skanova.net [81.228.8.164]) by mx1.FreeBSD.org (Postfix) with ESMTP id 5F7D143D49 for ; Tue, 12 Apr 2005 21:12:43 +0000 (GMT) (envelope-from daniel_k_eriksson@telia.com) Received: from sentinel (195.198.193.104) by pne-smtpout2-sn2.hy.skanova.net (7.1.026.7) id 41E3223E00B603F9 for freebsd-current@freebsd.org; Tue, 12 Apr 2005 23:12:42 +0200 From: "Daniel Eriksson" To: "'FreeBSD Current'" Date: Tue, 12 Apr 2005 23:13:09 +0200 Organization: Home Message-ID: MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit X-Mailer: Microsoft Office Outlook, Build 11.0.6353 X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2900.2527 Thread-Index: AcU/pG254VxRTrrETTuhb5uzDE3itA== Subject: task queue: supervisor write, page not present X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 12 Apr 2005 21:12:44 -0000 This is the third time in 4 days that I get the following crash on one of my servers. It's a dual AthlonMP machine, and at the time of the crash it wasn't doing much at all (running a few instances of a proprietary video server app). There's a dmesg at the bottom too. The log below is from a system running CURRENT from earlier today (2005.04.12.06.30.00). The other two crashes happened using sources dated 2005.04.08.04.00.00. /Daniel Eriksson Fatal trap 12: page fault while in kernel mode cpuid = 0; apic id = 01 fault virtual address = 0xc2b760b4 fault code = supervisor write, page not present instruction pointer = 0x8:0xc0578f53 stack pointer = 0x10:0xe09e7ca4 frame pointer = 0x10:0xe09e7ccc code segment = base 0x0, limit 0xfffff, type 0x1b = DPL 0, pres 1, def32 1, gran 1 processor eflags = interrupt enabled, resume, IOPL = 0 current process = 40 (swi6: task queue) [thread pid 40 tid 100036 ] Stopped at taskqueue_run+0x123: andl $-0x2,0x14(%ebx) db> where Tracing pid 40 tid 100036 td 0xc1eccd80 taskqueue_run(c1f3c180,e09e7d14,c053a678,0,0) at taskqueue_run+0x123 taskqueue_swi_run(0,0,0,0,0) at taskqueue_swi_run+0x13 ithread_loop(c1ed9180,e09e7d48,0,0,0) at ithread_loop+0x1a8 fork_exit(c053a4d0,c1ed9180,e09e7d48) at fork_exit+0x80 fork_trampoline() at fork_trampoline+0x8 --- trap 0x1, eip = 0, esp = 0xe09e7d7c, ebp = 0 --- db> ps pid proc uid ppid pgrp flag stat wmesg wchan cmd 11120 c25bb7f0 0 612 11120 0004100 [CPU 1] mcvidserv 10639 c28c09ec 0 612 10639 0004100 [SLPQ biord 0xd17c6b30][SLP] mcvidserv 10532 c3e9a1fc 0 612 10532 0004100 [SLPQ sbwait 0xc2456cb4][SLP] mcvidserv 7902 c250e5f4 0 612 7902 0004100 [SLPQ sbwait 0xc2284cb4][SLP] mcvidserv 1725 c2814be8 0 612 1725 0004100 [SLPQ nanslp 0xc07930ac][SLP] mcvidserv 3372 c28bd9ec 0 533 533 0000101 [SLPQ select 0xc0799c04][SLP] smbd 860 c25b57f0 0 850 860 0004002 [SLPQ nanslp 0xc07930ac][SLP] mfk 850 c2814de4 0 849 850 0004002 [SLPQ pause 0xc2814e18][SLP] csh 849 c25b59ec 0 1 849 0000000 [SLPQ select 0xc0799c04][SLP] screen 771 c28c03f8 1001 1 771 0000002 [SLPQ select 0xc0799c04][SLP] ctrail 720 c28145f4 0 1 720 0000000 [SLPQ ggwait 0xc27b6000][SLP] ggatec 714 c212b1fc 0 1 714 0000000 [SLPQ ggwait 0xc27ac000][SLP] ggatec 705 c218c9ec 0 1 705 0000000 [SLPQ ggwait 0xc27b5000][SLP] ggatec 696 c25bb000 0 1 696 0000000 [SLPQ ggwait 0xc2773000][SLP] ggatec 685 c25b53f8 0 1 685 0000000 [SLPQ ggwait 0xc215c000][SLP] ggatec 678 c25b5de4 0 1 678 0000000 [SLPQ ggwait 0xc2506000][SLP] ggatec 635 c25b5be8 0 0 0 0000204 [SLPQ - 0xc1f47000][SLP] g_bde da0s1g.bde 627 c250e9ec 0 0 0 0000204 [SLPQ - 0xc218e000][SLP] gv_v 480GB 626 c25bb1fc 0 0 0 0000204 [SLPQ - 0xc1f88a00][SLP] gv_p 480GB.p0 625 c25bb3f8 0 0 0 0000204 [SLPQ - 0xc25b9c00][SLP] gv_d vd2 624 c25bb5f4 0 0 0 0000204 [SLPQ - 0xc218ee00][SLP] gv_d vd3 623 c250f3f8 0 0 0 0000204 [SLPQ - 0xc21bab00][SLP] gv_d vd0 622 c250e7f0 0 0 0 0000204 [SLPQ - 0xc2513600][SLP] gv_d vd1 621 c212ade4 0 1 621 0004002 [SLPQ ttyin 0xc1fcfc10][SLP] getty 620 c218c3f8 0 1 620 0004002 [SLPQ ttyin 0xc1fd7410][SLP] getty 619 c212abe8 0 1 619 0004002 [SLPQ ttyin 0xc1fa3c10][SLP] getty 618 c250f1fc 0 1 618 0004002 [SLPQ ttyin 0xc1fd7010][SLP] getty 617 c212a9ec 0 1 617 0004002 [SLPQ ttyin 0xc1fd6810][SLP] getty 612 c218c7f0 0 1 612 0000000 [SLPQ select 0xc0799c04][SLP] inetd 572 c250e1fc 0 1 571 0000000 [SLPQ select 0xc0799c04][SLP] snmpd 564 c250ebe8 0 1 563 0000000 [SLPQ nanslp 0xc07930ac][SLP] smartd 560 c21899ec 0 559 560 0004002 [SLPQ ttyin 0xc20f0010][SLP] csh 559 c250f000 1001 546 559 0004102 [SLPQ wait 0xc250f000][SLP] su 546 c2189de4 1001 545 546 0004002 [SLPQ pause 0xc2189e18][SLP] csh 545 c212b9ec 1001 542 542 0000100 [SLPQ select 0xc0799c04][SLP] sshd 542 c1fdbde4 0 470 542 0004100 [SLPQ sbwait 0xc2490718][SLP] sshd 541 c212b3f8 0 533 533 0000101 [SLPQ pause 0xc212b42c][SLP] smbd 533 c21893f8 0 1 533 0000101 [SLPQ select 0xc0799c04][SLP] smbd 529 c21891fc 0 1 529 0000001 [SLPQ select 0xc0799c04][SLP] nmbd 509 c21897f0 65534 1 509 0000100 [SLPQ select 0xc0799c04][SLP] identd 496 c218c1fc 0 1 496 0000000 [SLPQ nanslp 0xc07930ac][SLP] cron 480 c212bde4 25 1 480 0000100 [SLPQ pause 0xc212be18][SLP] sendmail 476 c212a1fc 0 1 476 0000100 [SLPQ select 0xc0799c04][SLP] sendmail 470 c212a5f4 0 1 470 0000100 [SLPQ select 0xc0799c04][SLP] sshd 451 c21895f4 0 1 451 0000000 [SLPQ select 0xc0799c04][SLP] ntpd 344 c218c000 0 1 344 0000000 [SLPQ select 0xc0799c04][SLP] syslogd 315 c212a7f0 0 1 315 0000000 [SLPQ select 0xc0799c04][SLP] devd 171 c212a3f8 0 1 171 0000000 [SLPQ pause 0xc212a42c][SLP] adjkerntz 56 c212b7f0 0 0 0 0000204 [SLPQ - 0xe46a4d0c][SLP] schedcpu 55 c1ecd3f8 0 0 0 0000204 [SLPQ - 0xc079d52c][SLP] nfsiod 3 54 c1ecd5f4 0 0 0 0000204 [SLPQ - 0xc079d528][SLP] nfsiod 2 53 c1ecd7f0 0 0 0 0000204 [SLPQ - 0xc079d524][SLP] nfsiod 1 52 c1ecd9ec 0 0 0 0000204 [SLPQ - 0xc079d520][SLP] nfsiod 0 51 c1ecdbe8 0 0 0 0000204 [SLPQ vlruwt 0xc1ecdbe8][SLP] vnlru 50 c1ecdde4 0 0 0 0000204 [SLPQ syncer 0xc0792e0c][SLP] syncer 49 c1fdb000 0 0 0 0000204 [SLPQ psleep 0xc079a170][SLP] bufdaemon 48 c1fdb1fc 0 0 0 0000204 [SLPQ pollid 0xc0792464][SLP] idlepoll 47 c1fdb3f8 0 0 0 000020c [SLPQ pgzero 0xc07a3c24][SLP] pagezero 46 c1fdb5f4 0 0 0 0000204 [SLPQ psleep 0xc07a3774][SLP] vmdaemon 45 c1fdb7f0 0 0 0 0000204 [SLPQ psleep 0xc07a3730][SLP] pagedaemon 9 c1fdb9ec 0 0 0 0000204 [SLPQ - 0xc1fb843c][SLP] fdc0 44 c1fdbbe8 0 0 0 0000204 [IWAIT] swi0: sio 8 c1ec0be8 0 0 0 0000204 [SLPQ idle 0xc1f6dc74][SLP] ciss_notify0 7 c1ec0de4 0 0 0 0000204 [SLPQ actask 0xc08a0f2c][SLP] acpi_task0 43 c1ecb000 0 0 0 0000204 [IWAIT] swi5:+ 42 c1ecb1fc 0 0 0 0000204 [IWAIT] swi6: acpitaskq 6 c1ecb3f8 0 0 0 0000204 [SLPQ - 0xc1f3c080][SLP] thread taskq 41 c1ecb5f4 0 0 0 0000204 [IWAIT] swi6:+ 40 c1ecb7f0 0 0 0 0000204 [CPU 0] swi6: task queue 5 c1ecb9ec 0 0 0 0000204 [SLPQ - 0xc1f3c1c0][SLP] kqueue taskq 39 c1ecbbe8 0 0 0 0000204 [IWAIT] swi2: cambio 38 c1ecbde4 0 0 0 0000204 [SLPQ - 0xc078bdc0][SLP] yarrow 4 c1ecd000 0 0 0 0000204 [SLPQ - 0xc0790228][SLP] g_down 3 c1ecd1fc 0 0 0 0000204 [SLPQ - 0xc0790224][SLP] g_up 2 c1eb05f4 0 0 0 0000204 [SLPQ - 0xc079021c][SLP] g_event 37 c1eb07f0 0 0 0 0000204 [RUNQ] swi1: net 36 c1eb09ec 0 0 0 0000204 [IWAIT] swi3: vm 35 c1eb0be8 0 0 0 000020c [RUNQ] swi4: clock sio 34 c1eb0de4 0 0 0 0000204 [IWAIT] irq23: 33 c1ec0000 0 0 0 0000204 [IWAIT] irq22: em1 32 c1ec01fc 0 0 0 0000204 [IWAIT] irq21: em0 31 c1ec03f8 0 0 0 0000204 [IWAIT] irq20: ciss0 30 c1ec05f4 0 0 0 0000204 [IWAIT] irq19: atapci3+ 29 c1ec07f0 0 0 0 0000204 [IWAIT] irq18: 28 c1ec09ec 0 0 0 0000204 [LOCK taskqueue c1e01140] irq17: atapci1+ 27 c1e0b1fc 0 0 0 0000204 [IWAIT] irq16: 26 c1e0b3f8 0 0 0 0000204 [IWAIT] irq15: ata1 25 c1e0b5f4 0 0 0 0000204 [IWAIT] irq14: ata0 24 c1e0b7f0 0 0 0 0000204 [IWAIT] irq13: 23 c1e0b9ec 0 0 0 0000204 [IWAIT] irq12: 22 c1e0bbe8 0 0 0 0000204 [IWAIT] irq11: 21 c1e0bde4 0 0 0 0000204 [IWAIT] irq10: 20 c1eb0000 0 0 0 0000204 [IWAIT] irq9: acpi0 19 c1eb01fc 0 0 0 0000204 [IWAIT] irq8: 18 c1eb03f8 0 0 0 0000204 [IWAIT] irq7: 17 c1e06000 0 0 0 0000204 [IWAIT] irq6: fdc0 16 c1e061fc 0 0 0 0000204 [IWAIT] irq5: 15 c1e063f8 0 0 0 0000204 [IWAIT] irq4: sio0 14 c1e065f4 0 0 0 0000204 [IWAIT] irq3: 13 c1e067f0 0 0 0 0000204 [IWAIT] irq0: 12 c1e069ec 0 0 0 0000204 [IWAIT] irq1: atkbd0 11 c1e06be8 0 0 0 000020c [Can run] idle: cpu0 10 c1e06de4 0 0 0 000020c [Can run] idle: cpu1 1 c1e0b000 0 0 1 0004200 [SLPQ wait 0xc1e0b000][SLP] init 0 c0790320 0 0 0 0000200 [SLPQ sched 0xc0790320][SLP] swapper And here's part of the dmesg: /boot/kernel/kernel text=0x3528bc data=0x36388+0x33c38 syms=[0x4+0x42940+0x4+0x537ec] /boot/kernel/acpi.ko text=0x49fa0 data=0x2124+0x110c syms=[0x4+0x7730+0x4+0x9ec3] KDB: debugger backends: ddb KDB: current backend: ddb Copyright (c) 1992-2005 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD 6.0-CURRENT #0: Tue Apr 12 10:23:40 CEST 2005 daniel@xxx:/usr/obj/usr/src/sys/XXX Timecounter "i8254" frequency 1193182 Hz quality 0 CPU: AMD Athlon(tm) MP 2600+ (2000.08-MHz 686-class CPU) Origin = "AuthenticAMD" Id = 0x6a0 Stepping = 0 Features=0x383fbff AMD Features=0xc0480000 real memory = 804782080 (767 MB) avail memory = 778342400 (742 MB) ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs cpu0 (BSP): APIC ID: 1 cpu1 (AP): APIC ID: 0 MADT: Forcing active-low polarity and level trigger for SCI ioapic0 irqs 0-23 on motherboard npx0: [FAST] npx0: on motherboard npx0: INT 16 interface acpi0: on motherboard acpi0: Power Button (fixed) acpi0: Sleep Button (fixed) Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x8008-0x800b on acpi0 cpu0: on acpi0 cpu1: on acpi0 acpi_button0: on acpi0 pcib0: port 0xcf8-0xcff,0x8000-0x807f,0x8080-0x80ff iomem 0xd8000-0xdbfff on acpi0 pci0: on pcib0 agp0: port 0x1490-0x1493 mem 0xec000000-0xedffffff,0xea100000-0xea100fff at device 0.0 on pci0 pcib1: at device 1.0 on pci0 pci1: on pcib1 pci1: at device 5.0 (no driver attached) isab0: at device 7.0 on pci0 isa0: on isab0 atapci0: port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xf000-0xf00f at device 7.1 on pci0 ata0: on atapci0 ata1: on atapci0 pci0: at device 7.3 (no driver attached) ciss0: port 0x1000-0x10ff mem 0xe8100000-0xe813ffff,0xe8000000-0xe80fffff irq 20 at device 8.0 on pci0 ciss0: [GIANT-LOCKED] em0: port 0x1400-0x143f mem 0xe81c0000-0xe81dffff,0xe8140000-0xe817ffff irq 21 at device 9.0 on pci0 em0: Ethernet address: 00:04:23:ac:20:8a em0: Speed:N/A Duplex:N/A em1: port 0x1440-0x147f mem 0xe81e0000-0xe81fffff,0xe8180000-0xe81bffff irq 22 at device 9.1 on pci0 em1: Ethernet address: 00:04:23:ac:20:8b em1: Speed:N/A Duplex:N/A pcib2: at device 16.0 on pci0 pci2: on pcib2 atapci1: port 0x3010-0x3017,0x3004-0x3007,0x3008-0x300f,0x3000-0x3003,0x2000-0x20ff irq 17 at device 5.0 on pci2 ata2: on atapci1 ata3: on atapci1 atapci2: port 0x3028-0x302f,0x301c-0x301f,0x3020-0x3027,0x3018-0x301b,0x2400-0x24ff irq 17 at device 5.1 on pci2 ata4: on atapci2 ata5: on atapci2 atapci3: port 0x3040-0x3047,0x3034-0x3037,0x3038-0x303f,0x3030-0x3033,0x2800-0x28ff irq 19 at device 7.0 on pci2 ata6: on atapci3 ata7: on atapci3 atapci4: port 0x3058-0x305f,0x304c-0x304f,0x3050-0x3057,0x3048-0x304b,0x2c00-0x2cff irq 19 at device 7.1 on pci2 ata8: on atapci4 ata9: on atapci4 pci_link0: irq 5 on acpi0 pci_link1: irq 3 on acpi0 pci_link2: irq 11 on acpi0 pci_link3: irq 10 on acpi0 atkbdc0: port 0x60,0x64 irq 1 on acpi0 atkbd0: irq 1 on atkbdc0 kbd0 at atkbd0 atkbd0: [GIANT-LOCKED] sio0: <16550A-compatible COM port> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 sio0: type 16550A, console fdc0: port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on acpi0 fdc0: [FAST] fd0: <1440-KB 3.5" drive> on fdc0 drive 0 pmtimer0 on isa0 orm0: at iomem 0xc0000-0xcafff,0xcb000-0xcefff,0xe0000-0xe3fff on isa0 sc0: at flags 0x100 on isa0 sc0: VGA <16 virtual consoles, flags=0x100> vga0: at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0 sio1: configured irq 3 not in bitmap of probed irqs 0 sio1: port may not be enabled Timecounters tick every 1.000 msec ipfw2 initialized, divert loadable, rule-based forwarding disabled, default to accept, logging unlimited ad0: 117800MB at ata0-master UDMA100 ad1: 117800MB at ata0-slave UDMA100 ad2: 117800MB at ata1-master UDMA100 ad3: 117800MB at ata1-slave UDMA100 ad4: 238475MB at ata2-master UDMA100 ad5: 238475MB at ata2-slave UDMA100 ad6: 239372MB at ata3-master UDMA133 ad7: 239372MB at ata3-slave UDMA133 ad8: 194481MB at ata4-master UDMA133 ad9: 194481MB at ata4-slave UDMA133 ad10: 239372MB at ata5-master UDMA133 ad12: 114473MB at ata6-master UDMA100 ad13: 114473MB at ata6-slave UDMA100 ad14: 117246MB at ata7-master UDMA133 ad15: 117246MB at ata7-slave UDMA133 ad16: 114473MB at ata8-master UDMA100 ad17: 117800MB at ata8-slave UDMA100 ad18: 194481MB at ata9-master UDMA133 ad19: 239372MB at ata9-slave UDMA133 da0 at ciss0 bus 0 target 0 lun 0 da0: Fixed Direct Access SCSI-0 device da0: 135.168MB/s transfers da0: 105008MB (215056800 512 byte sectors: 255H 32S/T 26355C) da1 at ciss0 bus 0 target 1 lun 0 da1: Fixed Direct Access SCSI-0 device da1: 135.168MB/s transfers da1: 486240MB (995821155 512 byte sectors: 255H 63S/T 61987C) ATA PseudoRAID loaded ar0: 476950MB status: READY ar0: disk0 READY using ad4 at ata2-master ar0: disk1 READY using ad5 at ata2-slave ar1: 478744MB status: READY ar1: disk0 READY using ad6 at ata3-master ar1: disk1 READY using ad7 at ata3-slave ar2: 583442MB status: READY ar2: disk0 READY using ad8 at ata4-master ar2: disk1 READY using ad9 at ata4-slave ar2: disk2 READY using ad18 at ata9-master ar3: 478744MB status: READY ar3: disk0 READY using ad19 at ata9-slave ar3: disk1 READY using ad10 at ata5-master ar4: 343420MB status: READY ar4: disk0 READY using ad12 at ata6-master ar4: disk1 READY using ad13 at ata6-slave ar4: disk2 READY using ad16 at ata8-master ar5: 351740MB status: READY ar5: disk0 READY using ad14 at ata7-master ar5: disk1 READY using ad15 at ata7-slave ar5: disk2 READY using ad17 at ata8-slave SMP: AP CPU #1 Launched! Trying to mount root from ufs:/dev/da0s1a Pre-seeding PRNG: kickstart. Loading configuration files. kernel dumps on /dev/da0s1b Entropy harvesting: point_to_point kickstart. swapon: adding /dev/da0s1b as swap device Starting file system checks: /dev/da0s1a: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/da0s1a: clean, 124444 free (1100 frags, 15418 blocks, 0.4% fragmentation) /dev/da0s1e: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/da0s1e: clean, 253807 free (31 frags, 31722 blocks, 0.0% fragmentation) /dev/da0s1f: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/da0s1f: clean, 3082494 free (29310 frags, 381648 blocks, 0.6% fragmentation) /dev/da0s1d: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/da0s1d: clean, 207823 free (975 frags, 25856 blocks, 0.4% fragmentation) /dev/da0s1h: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/da0s1h: clean, 31567485 free (557 frags, 3945866 blocks, 0.0% fragmentation) Setting hostname: xxx. net.inet.tcp.sendspace: 32768 -> 2097152 net.inet.tcp.recvspace: 65536 -> 2097152 kern.ipc.maxsockbuf: 262144 -> 16777216 kern.ipc.somaxconn: 128 -> 256 net.inet.ip.intr_queue_maxlen: 50 -> 128 kern.polling.enable: 0 -> 1 kern.polling.burst_max: 150 -> 300 kern.polling.each_burst: 5 -> 50 kern.polling.poll_in_trap: 0 -> 1 kern.polling.user_frac: 50 -> 33 vfs.hirunningspace: 1048576 -> 8388608 ...