Skip site navigation (1)Skip section navigation (2)
Date:      Tue, 11 Nov 2014 00:10:22 +0000
From:      bugzilla-noreply@freebsd.org
To:        freebsd-bugs@FreeBSD.org
Subject:   [Bug 194938] New: [10.1-RC4-p1][panic] panic by setting sysctl vfs.zfs.vdev.aggregation_limit (with backtrace)
Message-ID:  <bug-194938-8@https.bugs.freebsd.org/bugzilla/>

next in thread | raw e-mail | index | archive | help
https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=194938

            Bug ID: 194938
           Summary: [10.1-RC4-p1][panic] panic by setting sysctl
                    vfs.zfs.vdev.aggregation_limit (with backtrace)
           Product: Base System
           Version: 10.1-RC2
          Hardware: amd64
                OS: Any
            Status: Needs Triage
          Severity: Affects Only Me
          Priority: ---
         Component: kern
          Assignee: freebsd-bugs@FreeBSD.org
          Reporter: code.jpe@gmail.com

Hi,

I can reproduce the following kernel panic on 10.1-RC4-p1 by increasing the
sysctl vfs.zfs.vdev.aggregation_limit from 131072 to 1048576. The server
reliably panics within seconds.

I can not reproduce it on my 10.1-RC3 r273607, so I'll classify it as "Affects
Only Me".

Panic message:
panic: vm_fault: fault on nofault entry, addr: fffffe0020542000
cpuid = 1
KDB: stack backtrace:
#0 0xffffffff80988bc0 at kdb_backtrace+0x60
#1 0xffffffff8094da83 at panic+0x153
#2 0xffffffff80bf4963 at vm_fault_hold+0x1b63
#3 0xffffffff80bf2db7 at vm_fault+0x77
#4 0xffffffff80d7bbfc at trap_pfault+0x19c
#5 0xffffffff80d7b3ca at trap+0x47a
#6 0xffffffff80d61372 at calltrap+0x8
#7 0xffffffff81a8f579 at vdev_queue_io_done+0xc9
#8 0xffffffff81aa9829 at zio_vdev_io_done+0xd9
#9 0xffffffff81aa6382 at zio_execute+0x162
#10 0xffffffff80996eb5 at taskqueue_run_locked+0xe5
#11 0xffffffff80997938 at taskqueue_thread_loop+0xa8
#12 0xffffffff809185da at fork_exit+0x9a
#13 0xffffffff80d618ae at fork_trampoline+0xe
Uptime: 4m9s

System was built from:
# svnlite info /usr/src | egrep 'Rev|^URL'
URL: https://svn0.eu.freebsd.org/base/releng/10.1
Revision: 274348
Last Changed Rev: 274161

/etc/make.conf:
# cat /etc/make.conf
WITH_PKGNG=       YES
WITH_SSP_PORTS=   YES
DEFAULT_VERSIONS= perl5=5.18
CFLAGS=           -O2 -fno-strict-aliasing -pipe
COPTFLAGS=        -O -pipe
MAKE_SHELL?=      sh
CPUTYPE?=         athlon64-sse3
KERNCONF=         YGGDRASIL

/etc/src.conf:
# cat /etc/src.conf
WITH_BSD_GREP=YES
WITHOUT_AMD=YES
WITHOUT_AUTHPF=YES
WITHOUT_BLUETOOTH=YES
WITHOUT_CTM=YES
WITHOUT_FLOPPY=YES
WITHOUT_GAMES=YES
WITHOUT_HTML=YES
WITHOUT_INFO=YES
WITHOUT_IPX=YES
WITHOUT_IPX_SUPPORT=YES
WITHOUT_IPFILTER=YES
WITHOUT_LIB32=YES
WITHOUT_LPR=YES
WITHOUT_NDIS=YES
WITHOUT_PC_SYSINSTALL=YES
WITHOUT_PPP=YES
WITHOUT_RCMDS=YES
WITHOUT_RCS=YES
WITHOUT_SYSINSTALL=YES
WITHOUT_TELNET=YES
WITHOUT_WIRELESS=YES
WITHOUT_WIRELESS_SUPPORT=YES
WITHOUT_WPA_SUPPLICANT_EAPOL=YES


Core is available:
# kgdb kernel.debug /var/crash/vmcore.0
GNU gdb 6.1.1 [FreeBSD]
Copyright 2004 Free Software Foundation, Inc.
GDB is free software, covered by the GNU General Public License, and you are
welcome to change it and/or distribute copies of it under certain conditions.
Type "show copying" to see the conditions.
There is absolutely no warranty for GDB.  Type "show warranty" for details.
This GDB was configured as "amd64-marcel-freebsd"...
[... old dmesg ...]

panic: vm_fault: fault on nofault entry, addr: fffffe0020542000
cpuid = 1
KDB: stack backtrace:
#0 0xffffffff80988bc0 at kdb_backtrace+0x60
#1 0xffffffff8094da83 at panic+0x153
#2 0xffffffff80bf4963 at vm_fault_hold+0x1b63
#3 0xffffffff80bf2db7 at vm_fault+0x77
#4 0xffffffff80d7bbfc at trap_pfault+0x19c
#5 0xffffffff80d7b3ca at trap+0x47a
#6 0xffffffff80d61372 at calltrap+0x8
#7 0xffffffff81a8f579 at vdev_queue_io_done+0xc9
#8 0xffffffff81aa9829 at zio_vdev_io_done+0xd9
#9 0xffffffff81aa6382 at zio_execute+0x162
#10 0xffffffff80996eb5 at taskqueue_run_locked+0xe5
#11 0xffffffff80997938 at taskqueue_thread_loop+0xa8
#12 0xffffffff809185da at fork_exit+0x9a
#13 0xffffffff80d618ae at fork_trampoline+0xe
Uptime: 4m9s
Dumping 285 out of 4035 MB:..6%..12%..23%..34%..45%..51%..62%..73%..84%..96%

Reading symbols from /boot/kernel/nullfs.ko.symbols...done.
Loaded symbols for /boot/kernel/nullfs.ko.symbols
Reading symbols from /boot/kernel/zfs.ko.symbols...done.
Loaded symbols for /boot/kernel/zfs.ko.symbols
Reading symbols from /boot/kernel/opensolaris.ko.symbols...done.
Loaded symbols for /boot/kernel/opensolaris.ko.symbols
Reading symbols from /boot/kernel/geom_eli.ko.symbols...done.
Loaded symbols for /boot/kernel/geom_eli.ko.symbols
Reading symbols from /boot/kernel/geom_mirror.ko.symbols...done.
Loaded symbols for /boot/kernel/geom_mirror.ko.symbols
Reading symbols from /boot/kernel/pf.ko.symbols...done.
Loaded symbols for /boot/kernel/pf.ko.symbols
Reading symbols from /boot/kernel/mac_partition.ko.symbols...done.
Loaded symbols for /boot/kernel/mac_partition.ko.symbols
Reading symbols from /boot/kernel/mac_seeotheruids.ko.symbols...done.
Loaded symbols for /boot/kernel/mac_seeotheruids.ko.symbols
Reading symbols from /boot/kernel/mac_portacl.ko.symbols...done.
Loaded symbols for /boot/kernel/mac_portacl.ko.symbols
Reading symbols from /boot/kernel/cc_htcp.ko.symbols...done.
Loaded symbols for /boot/kernel/cc_htcp.ko.symbols
Reading symbols from /boot/kernel/uhid.ko.symbols...done.
Loaded symbols for /boot/kernel/uhid.ko.symbols
Reading symbols from /boot/kernel/ums.ko.symbols...done.
Loaded symbols for /boot/kernel/ums.ko.symbols
#0  doadump (textdump=<value optimized out>) at pcpu.h:219
219             __asm("movq %%gs:%1,%0" : "=r" (td)
(kgdb) backtrace
#0  doadump (textdump=<value optimized out>) at pcpu.h:219
#1  0xffffffff8094d702 in kern_reboot (howto=260)
    at /usr/src/sys/kern/kern_shutdown.c:452
#2  0xffffffff8094dac2 in panic (fmt=<value optimized out>)
    at /usr/src/sys/kern/kern_shutdown.c:759
#3  0xffffffff80bf4963 in vm_fault_hold (map=<value optimized out>,
    vaddr=<value optimized out>, fault_type=<value optimized out>,
    fault_flags=<value optimized out>, m_hold=<value optimized out>)
    at /usr/src/sys/vm/vm_fault.c:341
#4  0xffffffff80bf2db7 in vm_fault (map=0xfffff80002000000,
    vaddr=<value optimized out>, fault_type=2 '\002', fault_flags=0)
    at /usr/src/sys/vm/vm_fault.c:281
#5  0xffffffff80d7bbfc in trap_pfault (frame=0xfffffe00dab69560, usermode=0)
    at /usr/src/sys/amd64/amd64/trap.c:752
#6  0xffffffff80d7b3ca in trap (frame=0xfffffe00dab69560)
    at /usr/src/sys/amd64/amd64/trap.c:440
#7  0xffffffff80d61372 in calltrap ()
    at /usr/src/sys/amd64/amd64/exception.S:232
#8  0xffffffff80d79736 in bcopy () at /usr/src/sys/amd64/amd64/support.S:112
#9  0xffffffff81a8f2a2 in vdev_queue_io_to_issue (vq=0xfffff8001c3a93d8)
    at
/usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/vdev_queue.c:672
#10 0xffffffff81a8f579 in vdev_queue_io_done (zio=0xfffff8011c19d398)
    at
/usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/vdev_queue.c:807
#11 0xffffffff81aa9829 in zio_vdev_io_done (zio=0xfffff8011c19d398)
    at
/usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:2728
#12 0xffffffff81aa6382 in zio_execute (zio=0xfffff8011c19d398)
    at
/usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:1414
#13 0xffffffff80996eb5 in taskqueue_run_locked (queue=0xfffff8001c603600)
    at /usr/src/sys/kern/subr_taskqueue.c:342
#14 0xffffffff80997938 in taskqueue_thread_loop (arg=<value optimized out>)
    at /usr/src/sys/kern/subr_taskqueue.c:563
#15 0xffffffff809185da in fork_exit (
    callout=0xffffffff80997890 <taskqueue_thread_loop>,
    arg=0xfffff8001c3127a0, frame=0xfffffe00dab69c00)
    at /usr/src/sys/kern/kern_fork.c:996
---Type <return> to continue, or q <return> to quit---
#16 0xffffffff80d618ae in fork_trampoline ()
    at /usr/src/sys/amd64/amd64/exception.S:606
#17 0x0000000000000000 in ?? ()
Current language:  auto; currently minimal
(kgdb) quit


Server dmesg:
Copyright (c) 1992-2014 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
        The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 10.1-RC4-p1 #1 r274348: Mon Nov 10 19:37:56 UTC 2014
    root@yggdrasil:/usr/obj/usr/src/sys/YGGDRASIL amd64
FreeBSD clang version 3.4.1 (tags/RELEASE_34/dot1-final 208032) 20140512
CPU: AMD Athlon(tm) 64 X2 Dual Core Processor 5600+ (2900.03-MHz K8-class CPU)
  Origin = "AuthenticAMD"  Id = 0x60fb2  Family = 0xf  Model = 0x6b  Stepping =
2
 
Features=0x178bfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,MMX,FXSR,SSE,SSE2,HTT>
  Features2=0x2001<SSE3,CX16>
  AMD Features=0xea500800<SYSCALL,NX,MMX+,FFXSR,RDTSCP,LM,3DNow!+,3DNow!>
  AMD Features2=0x11f<LAHF,CMP,SVM,ExtAPIC,CR8,Prefetch>
real memory  = 4831838208 (4608 MB)
avail memory = 4081754112 (3892 MB)
Event timer "LAPIC" quality 400
ACPI APIC Table: <M S I  OEMAPIC >
FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs
FreeBSD/SMP: 1 package(s) x 2 core(s)
 cpu0 (BSP): APIC ID:  0
 cpu1 (AP): APIC ID:  1
Security policy loaded: TrustedBSD MAC/Partition (mac_partition)
Security policy loaded: TrustedBSD MAC/portacl (mac_portacl)
Security policy loaded: TrustedBSD MAC/seeotheruids (mac_seeotheruids)
WARNING: VIMAGE (virtualized network stack) is a highly experimental feature.
ioapic0 <Version 2.1> irqs 0-23 on motherboard
random: <Software, Yarrow> initialized
kbd1 at kbdmux0
netmap: loaded module
cryptosoft0: <software crypto> on motherboard
acpi0: <M S I OEMRSDT> on motherboard
acpi0: Power Button (fixed)
acpi0: reservation of 0, a0000 (3) failed
acpi0: reservation of 100000, ddf00000 (3) failed
cpu0: <ACPI CPU> on acpi0
cpu1: <ACPI CPU> on acpi0
attimer0: <AT timer> port 0x40-0x43 irq 0 on acpi0
Timecounter "i8254" frequency 1193182 Hz quality 0
Event timer "i8254" frequency 1193182 Hz quality 100
atrtc0: <AT realtime clock> port 0x70-0x71 irq 8 on acpi0
Event timer "RTC" frequency 32768 Hz quality 0
Timecounter "ACPI-safe" frequency 3579545 Hz quality 850
acpi_timer0: <32-bit timer at 3.579545MHz> port 0x808-0x80b on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
pcib1: <ACPI PCI-PCI bridge> at device 1.0 on pci0
pci1: <ACPI PCI bus> on pcib1
vgapci0: <VGA-compatible display> port 0xc000-0xc0ff mem
0xfc000000-0xfdffffff,0xfe9f0000-0xfe9fffff,0xfe800000-0xfe8fffff irq 18 at
device 5.0 on pci1
vgapci0: Boot video device
hdac0: <ATI RS690 HDA Controller> mem 0xfe9e8000-0xfe9ebfff irq 19 at device
5.2 on pci1
pcib2: <ACPI PCI-PCI bridge> at device 7.0 on pci0
pci2: <ACPI PCI bus> on pcib2
re0: <RealTek 8168/8111 B/C/CP/D/DP/E/F/G PCIe Gigabit Ethernet> port
0xd800-0xd8ff mem 0xfeaff000-0xfeafffff irq 19 at device 0.0 on pci2
re0: Using 1 MSI message
re0: Chip rev. 0x38000000
re0: MAC rev. 0x00000000
miibus0: <MII bus> on re0
rgephy0: <RTL8169S/8110S/8211 1000BASE-T media interface> PHY 1 on miibus0
rgephy0:  none, 10baseT, 10baseT-FDX, 10baseT-FDX-flow, 100baseTX,
100baseTX-FDX, 100baseTX-FDX-flow, 1000baseT, 1000baseT-master, 1000baseT-FDX,
1000baseT-FDX-master, 1000baseT-FDX-flow, 1000baseT-FDX-flow-master, auto,
auto-flow
re0: Ethernet address: 00:21:85:62:4f:73
001.000009 [2705] netmap_attach             success for re0 tx 1/256 rx 1/256
queues/slots
ahci0: <AMD SB600 AHCI SATA controller> port
0xb000-0xb007,0xa000-0xa003,0x9000-0x9007,0x8000-0x8003,0x7000-0x700f mem
0xfe7ff800-0xfe7ffbff irq 22 at device 18.0 on pci0
ahci0: AHCI v1.10 with 4 3Gbps ports, Port Multiplier supported
ahci0: quirks=0x1000<NOMSI>
ahcich0: <AHCI channel> at channel 0 on ahci0
ahcich1: <AHCI channel> at channel 1 on ahci0
ahcich2: <AHCI channel> at channel 2 on ahci0
ahcich3: <AHCI channel> at channel 3 on ahci0
ohci0: <OHCI (generic) USB controller> mem 0xfe7fe000-0xfe7fefff irq 16 at
device 19.0 on pci0
usbus0 on ohci0
ohci1: <OHCI (generic) USB controller> mem 0xfe7fd000-0xfe7fdfff irq 17 at
device 19.1 on pci0
usbus1 on ohci1
ohci2: <OHCI (generic) USB controller> mem 0xfe7fc000-0xfe7fcfff irq 18 at
device 19.2 on pci0
usbus2 on ohci2
ohci3: <OHCI (generic) USB controller> mem 0xfe7fb000-0xfe7fbfff irq 17 at
device 19.3 on pci0
usbus3 on ohci3
ohci4: <OHCI (generic) USB controller> mem 0xfe7fa000-0xfe7fafff irq 18 at
device 19.4 on pci0
usbus4 on ohci4
ehci0: <EHCI (generic) USB 2.0 controller> mem 0xfe7ff000-0xfe7ff0ff irq 19 at
device 19.5 on pci0
ehci0: AMD SB600/700 quirk applied
usbus5: EHCI version 1.0
usbus5 on ehci0
atapci0: <ATI IXP600 UDMA133 controller> port
0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xff00-0xff0f at device 20.1 on pci0
ata0: <ATA channel> at channel 0 on atapci0
isab0: <PCI-ISA bridge> at device 20.3 on pci0
isa0: <ISA bus> on isab0
pcib3: <ACPI PCI-PCI bridge> at device 20.4 on pci0
pci3: <ACPI PCI bus> on pcib3
acpi_button0: <Power Button> on acpi0
uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0
atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
orm0: <ISA Option ROM> at iomem 0xcd800-0xce7ff on isa0
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x300>
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
ppc0: cannot reserve I/O port range
acpi_throttle0: <ACPI CPU Throttling> on cpu0
acpi_throttle0: CLK_VAL field overlaps THT_EN bit
device_attach: acpi_throttle0 attach returned 6
powernow0: <PowerNow! K8> on cpu0
powernow1: <PowerNow! K8> on cpu1
ZFS NOTICE: Prefetch is disabled by default if less than 4GB of RAM is present;
            to enable, add "vfs.zfs.prefetch_disable=0" to /boot/loader.conf.
ZFS filesystem version: 5
ZFS storage pool version: features support (5000)
Timecounters tick every 1.000 msec
IPsec: Initialized Security Association Processing.
hdacc0: <ATI RS690/780 HDA CODEC> at cad 0 on hdac0
hdaa0: <ATI RS690/780 Audio Function Group> at nid 1 on hdacc0
pcm0: <ATI RS690/780 (HDMI)> at nid 3 on hdaa0
random: unblocking device.
usbus0: 12Mbps Full Speed USB v1.0
usbus1: 12Mbps Full Speed USB v1.0
usbus2: 12Mbps Full Speed USB v1.0
usbus3: 12Mbps Full Speed USB v1.0
usbus4: 12Mbps Full Speed USB v1.0
usbus5: 480Mbps High Speed USB v2.0
ugen2.1: <ATI> at usbus2
uhub0: <ATI OHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus2
ugen1.1: <ATI> at usbus1
uhub1: <ATI OHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus1
ugen0.1: <ATI> at usbus0
uhub2: <ATI OHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus0
ugen5.1: <ATI> at usbus5
uhub3: <ATI EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus5
ugen4.1: <ATI> at usbus4
uhub4: <ATI OHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus4
ugen3.1: <ATI> at usbus3
uhub5: <ATI OHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus3
(aprobe0:ahcich0:0:15:0): NOP. ACB: 00 00 00 00 00 00 00 00 00 00 00 00
(aprobe0:ahcich0:0:15:0): CAM status: Command timeout
(aprobe0:ahcich0:0:15:0): Error 5, Retries exhausted
(aprobe0:ahcich0:0:15:0): NOP. ACB: 00 00 00 00 00 00 00 00 00 00 00 00
(aprobe0:ahcich0:0:15:0): CAM status: Command timeout
(aprobe0:ahcich0:0:15:0): Error 5, Retries exhausted
(aprobe2:ahcich2:0:15:0): NOP. ACB: 00 00 00 00 00 00 00 00 00 00 00 00
(aprobe2:ahcich2:0:15:0): CAM status: Command timeout
(aprobe2:ahcich2:0:15:0): Error 5, Retries exhausted
(aprobe2:ahcich2:0:15:0): NOP. ACB: 00 00 00 00 00 00 00 00 00 00 00 00
(aprobe2:ahcich2:0:15:0): CAM status: Command timeout
(aprobe2:ahcich2:0:15:0): Error 5, Retries exhausted
ada0 at ahcich0 bus 0 scbus0 target 0 lun 0
ada0: <SAMSUNG HD753LJ 1AA01108> ATA-7 SATA 2.x device
ada0: Serial Number S13UJ1NQ200080
ada0: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes)
ada0: Command Queueing enabled
ada0: 715404MB (1465149168 512 byte sectors: 16H 63S/T 16383C)
ada0: Previously was known as ad4
ada1 at ahcich2 bus 0 scbus2 target 0 lun 0
ada1: <SAMSUNG HD753LJ 1AA01118> ATA-7 SATA 2.x device
ada1: Serial Number S13UJDWZ102236
ada1: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes)
ada1: Command Queueing enabled
ada1: 715404MB (1465149168 512 byte sectors: 16H 63S/T 16383C)
ada1: Previously was known as ad8
uhub0: 2 ports with 2 removable, self powered
SMP: AP CPU #1 Launched!
uhub1: 2 ports with 2 removable, self powered
uhub2: 2 ports with 2 removable, self powered
uhub4: 2 ports with 2 removable, self powered
uhub5: 2 ports with 2 removable, self powered
Root mount waiting for: usbus5
Root mount waiting for: usbus5
Root mount waiting for: usbus5
Root mount waiting for: usbus5
uhub3: 10 ports with 10 removable, self powered
Root mount waiting for: usbus5
ugen5.2: <Peppercon AG> at usbus5
ukbd0: <Peppercon AG Multidevice, class 0/0, rev 2.00/0.01, addr 2> on usbus5
kbd2 at ukbd0
Root mount waiting for: usbus5
Trying to mount root from zfs:yggdrasil []...
ugen1.2: <CHESEN> at usbus1
ukbd1: <CHESEN PS2 to USB Converter, class 0/0, rev 1.10/0.10, addr 2> on
usbus1
kbd3 at ukbd1
uhid0: <Peppercon AG Multidevice, class 0/0, rev 2.00/0.01, addr 2> on usbus5
ums0: <CHESEN PS2 to USB Converter, class 0/0, rev 1.10/0.10, addr 2> on usbus1
ums0: 5 buttons and [XYZ] coordinates ID=1


The USB spam is from the Java web kvm thingy I used.

-- 
You are receiving this mail because:
You are the assignee for the bug.



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?bug-194938-8>