From owner-freebsd-bugs@FreeBSD.ORG Tue Nov 11 00:10:22 2014 Return-Path: Delivered-To: freebsd-bugs@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 773995F1 for ; Tue, 11 Nov 2014 00:10:22 +0000 (UTC) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 5DED595 for ; Tue, 11 Nov 2014 00:10:22 +0000 (UTC) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.14.9/8.14.9) with ESMTP id sAB0AMBx008506 for ; Tue, 11 Nov 2014 00:10:22 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-bugs@FreeBSD.org Subject: [Bug 194938] New: [10.1-RC4-p1][panic] panic by setting sysctl vfs.zfs.vdev.aggregation_limit (with backtrace) Date: Tue, 11 Nov 2014 00:10:22 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: new X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 10.1-RC2 X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: code.jpe@gmail.com X-Bugzilla-Status: Needs Triage X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-bugs@FreeBSD.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_id short_desc product version rep_platform op_sys bug_status bug_severity priority component assigned_to reporter Message-ID: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 7bit X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-bugs@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Bug reports List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 11 Nov 2014 00:10:22 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=194938 Bug ID: 194938 Summary: [10.1-RC4-p1][panic] panic by setting sysctl vfs.zfs.vdev.aggregation_limit (with backtrace) Product: Base System Version: 10.1-RC2 Hardware: amd64 OS: Any Status: Needs Triage Severity: Affects Only Me Priority: --- Component: kern Assignee: freebsd-bugs@FreeBSD.org Reporter: code.jpe@gmail.com Hi, I can reproduce the following kernel panic on 10.1-RC4-p1 by increasing the sysctl vfs.zfs.vdev.aggregation_limit from 131072 to 1048576. The server reliably panics within seconds. I can not reproduce it on my 10.1-RC3 r273607, so I'll classify it as "Affects Only Me". Panic message: panic: vm_fault: fault on nofault entry, addr: fffffe0020542000 cpuid = 1 KDB: stack backtrace: #0 0xffffffff80988bc0 at kdb_backtrace+0x60 #1 0xffffffff8094da83 at panic+0x153 #2 0xffffffff80bf4963 at vm_fault_hold+0x1b63 #3 0xffffffff80bf2db7 at vm_fault+0x77 #4 0xffffffff80d7bbfc at trap_pfault+0x19c #5 0xffffffff80d7b3ca at trap+0x47a #6 0xffffffff80d61372 at calltrap+0x8 #7 0xffffffff81a8f579 at vdev_queue_io_done+0xc9 #8 0xffffffff81aa9829 at zio_vdev_io_done+0xd9 #9 0xffffffff81aa6382 at zio_execute+0x162 #10 0xffffffff80996eb5 at taskqueue_run_locked+0xe5 #11 0xffffffff80997938 at taskqueue_thread_loop+0xa8 #12 0xffffffff809185da at fork_exit+0x9a #13 0xffffffff80d618ae at fork_trampoline+0xe Uptime: 4m9s System was built from: # svnlite info /usr/src | egrep 'Rev|^URL' URL: https://svn0.eu.freebsd.org/base/releng/10.1 Revision: 274348 Last Changed Rev: 274161 /etc/make.conf: # cat /etc/make.conf WITH_PKGNG= YES WITH_SSP_PORTS= YES DEFAULT_VERSIONS= perl5=5.18 CFLAGS= -O2 -fno-strict-aliasing -pipe COPTFLAGS= -O -pipe MAKE_SHELL?= sh CPUTYPE?= athlon64-sse3 KERNCONF= YGGDRASIL /etc/src.conf: # cat /etc/src.conf WITH_BSD_GREP=YES WITHOUT_AMD=YES WITHOUT_AUTHPF=YES WITHOUT_BLUETOOTH=YES WITHOUT_CTM=YES WITHOUT_FLOPPY=YES WITHOUT_GAMES=YES WITHOUT_HTML=YES WITHOUT_INFO=YES WITHOUT_IPX=YES WITHOUT_IPX_SUPPORT=YES WITHOUT_IPFILTER=YES WITHOUT_LIB32=YES WITHOUT_LPR=YES WITHOUT_NDIS=YES WITHOUT_PC_SYSINSTALL=YES WITHOUT_PPP=YES WITHOUT_RCMDS=YES WITHOUT_RCS=YES WITHOUT_SYSINSTALL=YES WITHOUT_TELNET=YES WITHOUT_WIRELESS=YES WITHOUT_WIRELESS_SUPPORT=YES WITHOUT_WPA_SUPPLICANT_EAPOL=YES Core is available: # kgdb kernel.debug /var/crash/vmcore.0 GNU gdb 6.1.1 [FreeBSD] Copyright 2004 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "amd64-marcel-freebsd"... [... old dmesg ...] panic: vm_fault: fault on nofault entry, addr: fffffe0020542000 cpuid = 1 KDB: stack backtrace: #0 0xffffffff80988bc0 at kdb_backtrace+0x60 #1 0xffffffff8094da83 at panic+0x153 #2 0xffffffff80bf4963 at vm_fault_hold+0x1b63 #3 0xffffffff80bf2db7 at vm_fault+0x77 #4 0xffffffff80d7bbfc at trap_pfault+0x19c #5 0xffffffff80d7b3ca at trap+0x47a #6 0xffffffff80d61372 at calltrap+0x8 #7 0xffffffff81a8f579 at vdev_queue_io_done+0xc9 #8 0xffffffff81aa9829 at zio_vdev_io_done+0xd9 #9 0xffffffff81aa6382 at zio_execute+0x162 #10 0xffffffff80996eb5 at taskqueue_run_locked+0xe5 #11 0xffffffff80997938 at taskqueue_thread_loop+0xa8 #12 0xffffffff809185da at fork_exit+0x9a #13 0xffffffff80d618ae at fork_trampoline+0xe Uptime: 4m9s Dumping 285 out of 4035 MB:..6%..12%..23%..34%..45%..51%..62%..73%..84%..96% Reading symbols from /boot/kernel/nullfs.ko.symbols...done. Loaded symbols for /boot/kernel/nullfs.ko.symbols Reading symbols from /boot/kernel/zfs.ko.symbols...done. Loaded symbols for /boot/kernel/zfs.ko.symbols Reading symbols from /boot/kernel/opensolaris.ko.symbols...done. Loaded symbols for /boot/kernel/opensolaris.ko.symbols Reading symbols from /boot/kernel/geom_eli.ko.symbols...done. Loaded symbols for /boot/kernel/geom_eli.ko.symbols Reading symbols from /boot/kernel/geom_mirror.ko.symbols...done. Loaded symbols for /boot/kernel/geom_mirror.ko.symbols Reading symbols from /boot/kernel/pf.ko.symbols...done. Loaded symbols for /boot/kernel/pf.ko.symbols Reading symbols from /boot/kernel/mac_partition.ko.symbols...done. Loaded symbols for /boot/kernel/mac_partition.ko.symbols Reading symbols from /boot/kernel/mac_seeotheruids.ko.symbols...done. Loaded symbols for /boot/kernel/mac_seeotheruids.ko.symbols Reading symbols from /boot/kernel/mac_portacl.ko.symbols...done. Loaded symbols for /boot/kernel/mac_portacl.ko.symbols Reading symbols from /boot/kernel/cc_htcp.ko.symbols...done. Loaded symbols for /boot/kernel/cc_htcp.ko.symbols Reading symbols from /boot/kernel/uhid.ko.symbols...done. Loaded symbols for /boot/kernel/uhid.ko.symbols Reading symbols from /boot/kernel/ums.ko.symbols...done. Loaded symbols for /boot/kernel/ums.ko.symbols #0 doadump (textdump=) at pcpu.h:219 219 __asm("movq %%gs:%1,%0" : "=r" (td) (kgdb) backtrace #0 doadump (textdump=) at pcpu.h:219 #1 0xffffffff8094d702 in kern_reboot (howto=260) at /usr/src/sys/kern/kern_shutdown.c:452 #2 0xffffffff8094dac2 in panic (fmt=) at /usr/src/sys/kern/kern_shutdown.c:759 #3 0xffffffff80bf4963 in vm_fault_hold (map=, vaddr=, fault_type=, fault_flags=, m_hold=) at /usr/src/sys/vm/vm_fault.c:341 #4 0xffffffff80bf2db7 in vm_fault (map=0xfffff80002000000, vaddr=, fault_type=2 '\002', fault_flags=0) at /usr/src/sys/vm/vm_fault.c:281 #5 0xffffffff80d7bbfc in trap_pfault (frame=0xfffffe00dab69560, usermode=0) at /usr/src/sys/amd64/amd64/trap.c:752 #6 0xffffffff80d7b3ca in trap (frame=0xfffffe00dab69560) at /usr/src/sys/amd64/amd64/trap.c:440 #7 0xffffffff80d61372 in calltrap () at /usr/src/sys/amd64/amd64/exception.S:232 #8 0xffffffff80d79736 in bcopy () at /usr/src/sys/amd64/amd64/support.S:112 #9 0xffffffff81a8f2a2 in vdev_queue_io_to_issue (vq=0xfffff8001c3a93d8) at /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/vdev_queue.c:672 #10 0xffffffff81a8f579 in vdev_queue_io_done (zio=0xfffff8011c19d398) at /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/vdev_queue.c:807 #11 0xffffffff81aa9829 in zio_vdev_io_done (zio=0xfffff8011c19d398) at /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:2728 #12 0xffffffff81aa6382 in zio_execute (zio=0xfffff8011c19d398) at /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:1414 #13 0xffffffff80996eb5 in taskqueue_run_locked (queue=0xfffff8001c603600) at /usr/src/sys/kern/subr_taskqueue.c:342 #14 0xffffffff80997938 in taskqueue_thread_loop (arg=) at /usr/src/sys/kern/subr_taskqueue.c:563 #15 0xffffffff809185da in fork_exit ( callout=0xffffffff80997890 , arg=0xfffff8001c3127a0, frame=0xfffffe00dab69c00) at /usr/src/sys/kern/kern_fork.c:996 ---Type to continue, or q to quit--- #16 0xffffffff80d618ae in fork_trampoline () at /usr/src/sys/amd64/amd64/exception.S:606 #17 0x0000000000000000 in ?? () Current language: auto; currently minimal (kgdb) quit Server dmesg: Copyright (c) 1992-2014 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 10.1-RC4-p1 #1 r274348: Mon Nov 10 19:37:56 UTC 2014 root@yggdrasil:/usr/obj/usr/src/sys/YGGDRASIL amd64 FreeBSD clang version 3.4.1 (tags/RELEASE_34/dot1-final 208032) 20140512 CPU: AMD Athlon(tm) 64 X2 Dual Core Processor 5600+ (2900.03-MHz K8-class CPU) Origin = "AuthenticAMD" Id = 0x60fb2 Family = 0xf Model = 0x6b Stepping = 2 Features=0x178bfbff Features2=0x2001 AMD Features=0xea500800 AMD Features2=0x11f real memory = 4831838208 (4608 MB) avail memory = 4081754112 (3892 MB) Event timer "LAPIC" quality 400 ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs FreeBSD/SMP: 1 package(s) x 2 core(s) cpu0 (BSP): APIC ID: 0 cpu1 (AP): APIC ID: 1 Security policy loaded: TrustedBSD MAC/Partition (mac_partition) Security policy loaded: TrustedBSD MAC/portacl (mac_portacl) Security policy loaded: TrustedBSD MAC/seeotheruids (mac_seeotheruids) WARNING: VIMAGE (virtualized network stack) is a highly experimental feature. ioapic0 irqs 0-23 on motherboard random: initialized kbd1 at kbdmux0 netmap: loaded module cryptosoft0: on motherboard acpi0: on motherboard acpi0: Power Button (fixed) acpi0: reservation of 0, a0000 (3) failed acpi0: reservation of 100000, ddf00000 (3) failed cpu0: on acpi0 cpu1: on acpi0 attimer0: port 0x40-0x43 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 atrtc0: port 0x70-0x71 irq 8 on acpi0 Event timer "RTC" frequency 32768 Hz quality 0 Timecounter "ACPI-safe" frequency 3579545 Hz quality 850 acpi_timer0: <32-bit timer at 3.579545MHz> port 0x808-0x80b on acpi0 pcib0: port 0xcf8-0xcff on acpi0 pci0: on pcib0 pcib1: at device 1.0 on pci0 pci1: on pcib1 vgapci0: port 0xc000-0xc0ff mem 0xfc000000-0xfdffffff,0xfe9f0000-0xfe9fffff,0xfe800000-0xfe8fffff irq 18 at device 5.0 on pci1 vgapci0: Boot video device hdac0: mem 0xfe9e8000-0xfe9ebfff irq 19 at device 5.2 on pci1 pcib2: at device 7.0 on pci0 pci2: on pcib2 re0: port 0xd800-0xd8ff mem 0xfeaff000-0xfeafffff irq 19 at device 0.0 on pci2 re0: Using 1 MSI message re0: Chip rev. 0x38000000 re0: MAC rev. 0x00000000 miibus0: on re0 rgephy0: PHY 1 on miibus0 rgephy0: none, 10baseT, 10baseT-FDX, 10baseT-FDX-flow, 100baseTX, 100baseTX-FDX, 100baseTX-FDX-flow, 1000baseT, 1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, 1000baseT-FDX-flow, 1000baseT-FDX-flow-master, auto, auto-flow re0: Ethernet address: 00:21:85:62:4f:73 001.000009 [2705] netmap_attach success for re0 tx 1/256 rx 1/256 queues/slots ahci0: port 0xb000-0xb007,0xa000-0xa003,0x9000-0x9007,0x8000-0x8003,0x7000-0x700f mem 0xfe7ff800-0xfe7ffbff irq 22 at device 18.0 on pci0 ahci0: AHCI v1.10 with 4 3Gbps ports, Port Multiplier supported ahci0: quirks=0x1000 ahcich0: at channel 0 on ahci0 ahcich1: at channel 1 on ahci0 ahcich2: at channel 2 on ahci0 ahcich3: at channel 3 on ahci0 ohci0: mem 0xfe7fe000-0xfe7fefff irq 16 at device 19.0 on pci0 usbus0 on ohci0 ohci1: mem 0xfe7fd000-0xfe7fdfff irq 17 at device 19.1 on pci0 usbus1 on ohci1 ohci2: mem 0xfe7fc000-0xfe7fcfff irq 18 at device 19.2 on pci0 usbus2 on ohci2 ohci3: mem 0xfe7fb000-0xfe7fbfff irq 17 at device 19.3 on pci0 usbus3 on ohci3 ohci4: mem 0xfe7fa000-0xfe7fafff irq 18 at device 19.4 on pci0 usbus4 on ohci4 ehci0: mem 0xfe7ff000-0xfe7ff0ff irq 19 at device 19.5 on pci0 ehci0: AMD SB600/700 quirk applied usbus5: EHCI version 1.0 usbus5 on ehci0 atapci0: port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xff00-0xff0f at device 20.1 on pci0 ata0: at channel 0 on atapci0 isab0: at device 20.3 on pci0 isa0: on isab0 pcib3: at device 20.4 on pci0 pci3: on pcib3 acpi_button0: on acpi0 uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0 atkbdc0: port 0x60,0x64 irq 1 on acpi0 atkbd0: irq 1 on atkbdc0 kbd0 at atkbd0 atkbd0: [GIANT-LOCKED] orm0: at iomem 0xcd800-0xce7ff on isa0 sc0: at flags 0x100 on isa0 sc0: VGA <16 virtual consoles, flags=0x300> vga0: at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0 ppc0: cannot reserve I/O port range acpi_throttle0: on cpu0 acpi_throttle0: CLK_VAL field overlaps THT_EN bit device_attach: acpi_throttle0 attach returned 6 powernow0: on cpu0 powernow1: on cpu1 ZFS NOTICE: Prefetch is disabled by default if less than 4GB of RAM is present; to enable, add "vfs.zfs.prefetch_disable=0" to /boot/loader.conf. ZFS filesystem version: 5 ZFS storage pool version: features support (5000) Timecounters tick every 1.000 msec IPsec: Initialized Security Association Processing. hdacc0: at cad 0 on hdac0 hdaa0: at nid 1 on hdacc0 pcm0: at nid 3 on hdaa0 random: unblocking device. usbus0: 12Mbps Full Speed USB v1.0 usbus1: 12Mbps Full Speed USB v1.0 usbus2: 12Mbps Full Speed USB v1.0 usbus3: 12Mbps Full Speed USB v1.0 usbus4: 12Mbps Full Speed USB v1.0 usbus5: 480Mbps High Speed USB v2.0 ugen2.1: at usbus2 uhub0: on usbus2 ugen1.1: at usbus1 uhub1: on usbus1 ugen0.1: at usbus0 uhub2: on usbus0 ugen5.1: at usbus5 uhub3: on usbus5 ugen4.1: at usbus4 uhub4: on usbus4 ugen3.1: at usbus3 uhub5: on usbus3 (aprobe0:ahcich0:0:15:0): NOP. ACB: 00 00 00 00 00 00 00 00 00 00 00 00 (aprobe0:ahcich0:0:15:0): CAM status: Command timeout (aprobe0:ahcich0:0:15:0): Error 5, Retries exhausted (aprobe0:ahcich0:0:15:0): NOP. ACB: 00 00 00 00 00 00 00 00 00 00 00 00 (aprobe0:ahcich0:0:15:0): CAM status: Command timeout (aprobe0:ahcich0:0:15:0): Error 5, Retries exhausted (aprobe2:ahcich2:0:15:0): NOP. ACB: 00 00 00 00 00 00 00 00 00 00 00 00 (aprobe2:ahcich2:0:15:0): CAM status: Command timeout (aprobe2:ahcich2:0:15:0): Error 5, Retries exhausted (aprobe2:ahcich2:0:15:0): NOP. ACB: 00 00 00 00 00 00 00 00 00 00 00 00 (aprobe2:ahcich2:0:15:0): CAM status: Command timeout (aprobe2:ahcich2:0:15:0): Error 5, Retries exhausted ada0 at ahcich0 bus 0 scbus0 target 0 lun 0 ada0: ATA-7 SATA 2.x device ada0: Serial Number S13UJ1NQ200080 ada0: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes) ada0: Command Queueing enabled ada0: 715404MB (1465149168 512 byte sectors: 16H 63S/T 16383C) ada0: Previously was known as ad4 ada1 at ahcich2 bus 0 scbus2 target 0 lun 0 ada1: ATA-7 SATA 2.x device ada1: Serial Number S13UJDWZ102236 ada1: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes) ada1: Command Queueing enabled ada1: 715404MB (1465149168 512 byte sectors: 16H 63S/T 16383C) ada1: Previously was known as ad8 uhub0: 2 ports with 2 removable, self powered SMP: AP CPU #1 Launched! uhub1: 2 ports with 2 removable, self powered uhub2: 2 ports with 2 removable, self powered uhub4: 2 ports with 2 removable, self powered uhub5: 2 ports with 2 removable, self powered Root mount waiting for: usbus5 Root mount waiting for: usbus5 Root mount waiting for: usbus5 Root mount waiting for: usbus5 uhub3: 10 ports with 10 removable, self powered Root mount waiting for: usbus5 ugen5.2: at usbus5 ukbd0: on usbus5 kbd2 at ukbd0 Root mount waiting for: usbus5 Trying to mount root from zfs:yggdrasil []... ugen1.2: at usbus1 ukbd1: on usbus1 kbd3 at ukbd1 uhid0: on usbus5 ums0: on usbus1 ums0: 5 buttons and [XYZ] coordinates ID=1 The USB spam is from the Java web kvm thingy I used. -- You are receiving this mail because: You are the assignee for the bug.