Date: Wed, 8 May 2019 15:52:45 -0500 From: Larry Rosenman <ler@FreeBSD.org> To: freebsd-current@FreeBSD.org Subject: Crash loading dtraceall Message-ID: <20190508205245.ulbo6fusk3b4py7t@ler-imac.local>
next in thread | raw e-mail | index | archive | help
--swragf7kp7z3ilk7 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Greetings, Somewhere between r346483 and r347241 loading dtraceall causes a crash. I have the cores and kernels.=20 It's hard for me to bisect more than this, as the box is remote.=20 What more do you need? (this dump is fropm r347355).=20 [ler@oldtbh2.lerctr.org:/var/crash] $ more core.txt.5 oldtbh2.lerctr.org dumped core - see /var/crash/vmcore.5 Wed May 8 15:46:58 CDT 2019 FreeBSD oldtbh2.lerctr.org 13.0-CURRENT FreeBSD 13.0-CURRENT r347355 LER-MI= NIMAL amd64 panic: page fault GNU gdb 6.1.1 [FreeBSD] Copyright 2004 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain condition= s. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "amd64-marcel-freebsd"... Unread portion of the kernel message buffer: Fatal trap 12: page fault while in kernel mode cpuid =3D 3; apic id =3D 03 fault virtual address =3D 0x0 fault code =3D supervisor read data , page not present instruction pointer =3D 0x20:0xffffffff825cb5ea stack pointer =3D 0x28:0xfffffe00d74d7d90 frame pointer =3D 0x28:0xfffffe00d74d7df0 code segment =3D base 0x0, limit 0xfffff, type 0x1b =3D DPL 0, pres 1, long 1, def32 0, gran 1 processor eflags =3D interrupt enabled, resume, IOPL =3D 0 current process =3D 1531 (kldload) trap number =3D 12 panic: page fault cpuid =3D 3 time =3D 1557348131 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00d74d7= a40 vpanic() at vpanic+0x19d/frame 0xfffffe00d74d7a90 panic() at panic+0x43/frame 0xfffffe00d74d7af0 trap_fatal() at trap_fatal+0x394/frame 0xfffffe00d74d7b50 trap_pfault() at trap_pfault+0x49/frame 0xfffffe00d74d7bb0 trap() at trap+0x2b4/frame 0xfffffe00d74d7cc0 calltrap() at calltrap+0x8/frame 0xfffffe00d74d7cc0 --- trap 0xc, rip =3D 0xffffffff825cb5ea, rsp =3D 0xfffffe00d74d7d90, rbp = =3D 0xfffffe00d74d7df0 --- fbt_provide_module_function() at fbt_provide_module_function+0x7a/frame 0xf= ffffe00d74d7df0 link_elf_each_function_nameval() at link_elf_each_function_nameval+0xf7/fra= me 0xfffffe00d74d7e40 fbt_provide_module() at fbt_provide_module+0xde/frame 0xfffffe00d74d8270 fbt_linker_file_cb() at fbt_linker_file_cb+0x12/frame 0xfffffe00d74d8280 linker_file_foreach() at linker_file_foreach+0x52/frame 0xfffffe00d74d82b0 linker_load_module() at linker_load_module+0xbd8/frame 0xfffffe00d74d85e0 linker_load_dependencies() at linker_load_dependencies+0x2fd/frame 0xfffffe= 00d74d8630 link_elf_load_file() at link_elf_load_file+0x105e/frame 0xfffffe00d74d86f0 linker_load_module() at linker_load_module+0x9ef/frame 0xfffffe00d74d8a20 kern_kldload() at kern_kldload+0xa7/frame 0xfffffe00d74d8a60 sys_kldload() at sys_kldload+0x5b/frame 0xfffffe00d74d8a90 amd64_syscall() at amd64_syscall+0x25c/frame 0xfffffe00d74d8bb0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00d74d8bb0 --- syscall (304, FreeBSD ELF64, sys_kldload), rip =3D 0x8002de43a, rsp =3D= 0x7fffffffe658, rbp =3D 0x7fffffffebd0 --- Uptime: 2m40s Dumping 2258 out of 64482 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..= 91% Reading symbols from /boot/kernel/zfs.ko...Reading symbols from /usr/lib/de= bug//boot/kernel/zfs.ko.debug...done. done. Loaded symbols for /boot/kernel/zfs.ko Reading symbols from /boot/kernel/krpc.ko...Reading symbols from /usr/lib/d= ebug//boot/kernel/krpc.ko.debug...done. done. Loaded symbols for /boot/kernel/krpc.ko Reading symbols from /boot/kernel/opensolaris.ko...Reading symbols from /us= r/lib/debug//boot/kernel/opensolaris.ko.debug...done. done. Loaded symbols for /boot/kernel/opensolaris.ko Reading symbols from /boot/kernel/if_em.ko...Reading symbols from /usr/lib/= debug//boot/kernel/if_em.ko.debug...done. done. Loaded symbols for /boot/kernel/if_em.ko Reading symbols from /boot/kernel/iflib.ko...Reading symbols from /usr/lib/= debug//boot/kernel/iflib.ko.debug...done. done. Loaded symbols for /boot/kernel/iflib.ko Reading symbols from /boot/kernel/if_bce.ko...Reading symbols from /usr/lib= /debug//boot/kernel/if_bce.ko.debug...done. done. Loaded symbols for /boot/kernel/if_bce.ko Reading symbols from /boot/kernel/miibus.ko...Reading symbols from /usr/lib= /debug//boot/kernel/miibus.ko.debug...done. done. Loaded symbols for /boot/kernel/miibus.ko Reading symbols from /boot/kernel/coretemp.ko...Reading symbols from /usr/l= ib/debug//boot/kernel/coretemp.ko.debug...done. done. Loaded symbols for /boot/kernel/coretemp.ko Reading symbols from /boot/kernel/filemon.ko...Reading symbols from /usr/li= b/debug//boot/kernel/filemon.ko.debug...done. done. Loaded symbols for /boot/kernel/filemon.ko Reading symbols from /boot/kernel/fuse.ko...Reading symbols from /usr/lib/d= ebug//boot/kernel/fusefs.ko.debug...done. done. Loaded symbols for /boot/kernel/fuse.ko Reading symbols from /boot/kernel/linux.ko...Reading symbols from /usr/lib/= debug//boot/kernel/linux.ko.debug...done. done. Loaded symbols for /boot/kernel/linux.ko Reading symbols from /boot/kernel/linux_common.ko...Reading symbols from /u= sr/lib/debug//boot/kernel/linux_common.ko.debug...done. done. Loaded symbols for /boot/kernel/linux_common.ko Reading symbols from /boot/kernel/ichsmb.ko...Reading symbols from /usr/lib= /debug//boot/kernel/ichsmb.ko.debug...done. done. Loaded symbols for /boot/kernel/ichsmb.ko Reading symbols from /boot/kernel/smbus.ko...Reading symbols from /usr/lib/= debug//boot/kernel/smbus.ko.debug...done. done. Loaded symbols for /boot/kernel/smbus.ko Reading symbols from /boot/kernel/ichwd.ko...Reading symbols from /usr/lib/= debug//boot/kernel/ichwd.ko.debug...done. done. Loaded symbols for /boot/kernel/ichwd.ko Reading symbols from /boot/kernel/cpuctl.ko...Reading symbols from /usr/lib= /debug//boot/kernel/cpuctl.ko.debug...done. done. Loaded symbols for /boot/kernel/cpuctl.ko Reading symbols from /boot/kernel/crypto.ko...Reading symbols from /usr/lib= /debug//boot/kernel/crypto.ko.debug...done. done. Loaded symbols for /boot/kernel/crypto.ko Reading symbols from /boot/kernel/cryptodev.ko...Reading symbols from /usr/= lib/debug//boot/kernel/cryptodev.ko.debug...done. done. Loaded symbols for /boot/kernel/cryptodev.ko Reading symbols from /boot/kernel/ipmi.ko...Reading symbols from /usr/lib/d= ebug//boot/kernel/ipmi.ko.debug...done. done. Loaded symbols for /boot/kernel/ipmi.ko Reading symbols from /boot/kernel/hwpmc.ko...Reading symbols from /usr/lib/= debug//boot/kernel/hwpmc.ko.debug...done. done. Loaded symbols for /boot/kernel/hwpmc.ko Reading symbols from /boot/kernel/tcp_rack.ko...Reading symbols from /usr/l= ib/debug//boot/kernel/tcp_rack.ko.debug...done. done. Loaded symbols for /boot/kernel/tcp_rack.ko Reading symbols from /boot/kernel/mfip.ko...Reading symbols from /usr/lib/d= ebug//boot/kernel/mfip.ko.debug...done. done. Loaded symbols for /boot/kernel/mfip.ko Reading symbols from /boot/kernel/cam.ko...Reading symbols from /usr/lib/de= bug//boot/kernel/cam.ko.debug...done. done. Loaded symbols for /boot/kernel/cam.ko Reading symbols from /boot/kernel/usb.ko...Reading symbols from /usr/lib/de= bug//boot/kernel/usb.ko.debug...done. done. Loaded symbols for /boot/kernel/usb.ko Reading symbols from /boot/kernel/uhci.ko...Reading symbols from /usr/lib/d= ebug//boot/kernel/uhci.ko.debug...done. done. Loaded symbols for /boot/kernel/uhci.ko Reading symbols from /boot/kernel/xhci.ko...Reading symbols from /usr/lib/d= ebug//boot/kernel/xhci.ko.debug...done. done. Loaded symbols for /boot/kernel/xhci.ko Reading symbols from /boot/kernel/ehci.ko...Reading symbols from /usr/lib/d= ebug//boot/kernel/ehci.ko.debug...done. done. Loaded symbols for /boot/kernel/ehci.ko Reading symbols from /boot/kernel/ohci.ko...Reading symbols from /usr/lib/d= ebug//boot/kernel/ohci.ko.debug...done. done. Loaded symbols for /boot/kernel/ohci.ko Reading symbols from /boot/kernel/ukbd.ko...Reading symbols from /usr/lib/d= ebug//boot/kernel/ukbd.ko.debug...done. done. Loaded symbols for /boot/kernel/ukbd.ko Reading symbols from /boot/kernel/ums.ko...Reading symbols from /usr/lib/de= bug//boot/kernel/ums.ko.debug...done. done. Loaded symbols for /boot/kernel/ums.ko Reading symbols from /boot/kernel/usb_quirk.ko...Reading symbols from /usr/= lib/debug//boot/kernel/usb_quirk.ko.debug...done. done. Loaded symbols for /boot/kernel/usb_quirk.ko Reading symbols from /boot/kernel/usb_template.ko...Reading symbols from /u= sr/lib/debug//boot/kernel/usb_template.ko.debug...done. done. Loaded symbols for /boot/kernel/usb_template.ko Reading symbols from /boot/kernel/efirt.ko...Reading symbols from /usr/lib/= debug//boot/kernel/efirt.ko.debug...done. done. Loaded symbols for /boot/kernel/efirt.ko Reading symbols from /boot/kernel/nfscl.ko...Reading symbols from /usr/lib/= debug//boot/kernel/nfscl.ko.debug...done. done. Loaded symbols for /boot/kernel/nfscl.ko Reading symbols from /boot/kernel/nfscommon.ko...Reading symbols from /usr/= lib/debug//boot/kernel/nfscommon.ko.debug...done. done. Loaded symbols for /boot/kernel/nfscommon.ko Reading symbols from /boot/kernel/nfssvc.ko...Reading symbols from /usr/lib= /debug//boot/kernel/nfssvc.ko.debug...done. done. Loaded symbols for /boot/kernel/nfssvc.ko Reading symbols from /boot/kernel/nfslock.ko...Reading symbols from /usr/li= b/debug//boot/kernel/nfslock.ko.debug...done. done. Loaded symbols for /boot/kernel/nfslock.ko Reading symbols from /boot/kernel/nfsd.ko...Reading symbols from /usr/lib/d= ebug//boot/kernel/nfsd.ko.debug...done. done. Loaded symbols for /boot/kernel/nfsd.ko Reading symbols from /boot/kernel/nfslockd.ko...Reading symbols from /usr/l= ib/debug//boot/kernel/nfslockd.ko.debug...done. done. Loaded symbols for /boot/kernel/nfslockd.ko Reading symbols from /boot/kernel/ataintel.ko...Reading symbols from /usr/l= ib/debug//boot/kernel/ataintel.ko.debug...done. done. Loaded symbols for /boot/kernel/ataintel.ko Reading symbols from /boot/kernel/ata.ko...Reading symbols from /usr/lib/de= bug//boot/kernel/ata.ko.debug...done. done. Loaded symbols for /boot/kernel/ata.ko Reading symbols from /boot/kernel/atapci.ko...Reading symbols from /usr/lib= /debug//boot/kernel/atapci.ko.debug...done. done. Loaded symbols for /boot/kernel/atapci.ko Reading symbols from /boot/kernel/geom_label.ko...Reading symbols from /usr= /lib/debug//boot/kernel/geom_label.ko.debug...done. done. Loaded symbols for /boot/kernel/geom_label.ko Reading symbols from /boot/kernel/linux64.ko...Reading symbols from /usr/li= b/debug//boot/kernel/linux64.ko.debug...done. done. Loaded symbols for /boot/kernel/linux64.ko Reading symbols from /boot/kernel/smbios.ko...Reading symbols from /usr/lib= /debug//boot/kernel/smbios.ko.debug...done. done. Loaded symbols for /boot/kernel/smbios.ko Reading symbols from /boot/kernel/mac_ntpd.ko...Reading symbols from /usr/l= ib/debug//boot/kernel/mac_ntpd.ko.debug...done. done. Loaded symbols for /boot/kernel/mac_ntpd.ko Reading symbols from /boot/kernel/netgraph.ko...Reading symbols from /usr/l= ib/debug//boot/kernel/netgraph.ko.debug...done. done. Loaded symbols for /boot/kernel/netgraph.ko Reading symbols from /boot/kernel/ng_netflow.ko...Reading symbols from /usr= /lib/debug//boot/kernel/ng_netflow.ko.debug...done. done. Loaded symbols for /boot/kernel/ng_netflow.ko Reading symbols from /boot/kernel/ng_ksocket.ko...Reading symbols from /usr= /lib/debug//boot/kernel/ng_ksocket.ko.debug...done. done. Loaded symbols for /boot/kernel/ng_ksocket.ko Reading symbols from /boot/kernel/ng_ether.ko...Reading symbols from /usr/l= ib/debug//boot/kernel/ng_ether.ko.debug...done. done. Loaded symbols for /boot/kernel/ng_ether.ko Reading symbols from /boot/kernel/ng_socket.ko...Reading symbols from /usr/= lib/debug//boot/kernel/ng_socket.ko.debug...done. done. Loaded symbols for /boot/kernel/ng_socket.ko Reading symbols from /boot/kernel/dtraceall.ko...Reading symbols from /usr/= lib/debug//boot/kernel/dtraceall.ko.debug...done. done. Loaded symbols for /boot/kernel/dtraceall.ko Reading symbols from /boot/kernel/dtrace.ko...Reading symbols from /usr/lib= /debug//boot/kernel/dtrace.ko.debug...done. done. Loaded symbols for /boot/kernel/dtrace.ko Reading symbols from /boot/kernel/dtmalloc.ko...Reading symbols from /usr/l= ib/debug//boot/kernel/dtmalloc.ko.debug...done. done. Loaded symbols for /boot/kernel/dtmalloc.ko Reading symbols from /boot/kernel/fbt.ko...Reading symbols from /usr/lib/de= bug//boot/kernel/fbt.ko.debug...done. done. Loaded symbols for /boot/kernel/fbt.ko #0 doadump (textdump=3D1) at src/sys/amd64/include/pcpu.h:241 241 __asm("movq %%gs:%P1,%0" : "=3Dr" (td) : "n" (OFFSETOF_CURT= HREAD)); (kgdb) #0 doadump (textdump=3D1) at src/sys/amd64/include/pcpu.h:241 #1 0xffffffff80496320 in kern_reboot (howto=3D260) at /usr/src/sys/kern/kern_shutdown.c:470 #2 0xffffffff80496799 in vpanic (fmt=3D<value optimized out>, ap=3D<value optimized out>) at /usr/src/sys/kern/kern_shutdown.c:896 #3 0xffffffff804964d3 in panic (fmt=3D<value optimized out>) at /usr/src/sys/kern/kern_shutdown.c:823 #4 0xffffffff80767314 in trap_fatal (frame=3D0xfffffe00d74d7cd0, eva=3D0) at /usr/src/sys/amd64/amd64/trap.c:946 #5 0xffffffff80767379 in trap_pfault (frame=3D0xfffffe00d74d7cd0, usermode= =3D0) at src/sys/amd64/include/pcpu.h:241 #6 0xffffffff80766964 in trap (frame=3D0xfffffe00d74d7cd0) at /usr/src/sys/amd64/amd64/trap.c:441 #7 0xffffffff80740805 in calltrap () at /usr/src/sys/amd64/amd64/exception.S:232 #8 0xffffffff825cb5ea in fbt_provide_module_function (lf=3D0xfffff800020ff= 000, symindx=3D30763, symval=3D0xfffffe00d74d7e00, opaque=3D0xfffffe00d74d7e= 50) at /usr/src/sys/cddl/dev/fbt/x86/fbt_isa.c:190 #9 0xffffffff804bf8f7 in link_elf_each_function_nameval ( file=3D0xfffff800020ff000, callback=3D0xffffffff825cb570 <fbt_provide_module_function>, opaque=3D0xfffffe00d74d7e50) at /usr/src/sys/kern/link_elf.c:1513 #10 0xffffffff825ca33e in fbt_provide_module (arg=3D<value optimized out>, lf=3D0xfffff800020ff000) at /usr/src/sys/cddl/dev/fbt/fbt.c:204 #11 0xffffffff825ca242 in fbt_linker_file_cb (lf=3D<value optimized out>, arg=3D<value optimized out>) at /usr/src/sys/cddl/dev/fbt/fbt.c:1103 #12 0xffffffff8046d772 in linker_file_foreach ( predicate=3D0xffffffff825ca230 <fbt_linker_file_cb>, context=3D0x0) at /usr/src/sys/kern/kern_linker.c:594 #13 0xffffffff8046cb58 in linker_load_module (kldname=3D<value optimized ou= t>, modname=3D0xffffffff81d792ae "fbt", parent=3D<value optimized out>, verinfo=3D<value optimized out>, lfpp=3D0x0) at /usr/src/sys/kern/kern_linker.c:236 #14 0xffffffff8046f1bd in linker_load_dependencies (lf=3D0xfffff8002389a400) at /usr/src/sys/kern/kern_linker.c:2200 #15 0xffffffff80797f3e in link_elf_load_file (cls=3D<value optimized out>, filename=3D0xfffff80003d592c0 "/boot/kernel/dtraceall.ko", result=3D0xfffffe00d74d8898) at /usr/src/sys/kern/link_elf_obj.c:1010 #16 0xffffffff8046c96f in linker_load_module (kldname=3D<value optimized ou= t>, modname=3D0xfffff800231a7800 "dtraceall", parent=3D<value optimized out= >, verinfo=3D<value optimized out>, lfpp=3D0xfffffe00d74d8a38) at linker_i= f.h:180 #17 0xffffffff8046e297 in kern_kldload (td=3D0xfffff80114df9000, file=3D<value optimized out>, fileid=3D0xfffffe00d74d8a74) at /usr/src/sys/kern/kern_linker.c:1089 #18 0xffffffff8046e35b in sys_kldload (td=3D0xfffff80114df9000, uap=3D<value optimized out>) at /usr/src/sys/kern/kern_linker.c:1115 #19 0xffffffff80767ddc in amd64_syscall (td=3D0xfffff80114df9000, traced=3D= 0) at src/sys/amd64/amd64/../../kern/subr_syscall.c:135 #20 0xffffffff807410ed in fast_syscall_common () at /usr/src/sys/amd64/amd64/exception.S:504 #21 0x00000008002de43a in ?? () Previous frame inner to this frame (corrupt stack?) Current language: auto; currently minimal (kgdb) --=20 Larry Rosenman https://people.FreeBSD.org/~ler/ Phone: +1 214-642-9640 E-Mail: ler@FreeBSD.org US Mail: 5708 Sabbia Drive, Round Rock, TX 78665-2106 --swragf7kp7z3ilk7 Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQHBBAABCgCrFiEEHjgknedhWzvJgwVzaXyZsatIp30FAlzTQZ0tFIAAAAAAFQAP cGthLWFkZHJlc3NAZ251cGcub3JnbGVyQEZyZWVCU0Qub3JnXxSAAAAAAC4AKGlz c3Vlci1mcHJAbm90YXRpb25zLm9wZW5wZ3AuZmlmdGhob3JzZW1hbi5uZXQxRTM4 MjQ5REU3NjE1QjNCQzk4MzA1NzM2OTdDOTlCMUFCNDhBNzdEAAoJEGl8mbGrSKd9 Vr4H/iGoHa8aC1NQbOWZHs6rJivb2MxjyTFWipvX36NwWM/sfm73X8DvgO1NfA7u GBsNZJh2IxH5ax1YuRY1G8CK5Qk+xylvMtUq3L5aEX1SggvEdQ9nGDm56Djqo1bu XPWPQAEc6TKudEsnM40dcWUBRxNUCbnFghMI9z83g+9HzlXOJ5WgoV3Sir2unQWx k08WM58EIpwYRF61cxe5OLknoixm0WXRMfyruuRSX7dSCuz6yJtdUYAtdoogjC1b zT/94Er9KkpbMIY2iqeM2oRaQ+/1qRTlWszdfPDskWDbdmKtOK7tkjmpF1Gzw2L+ 0iKj9YVZQP6qJrAk2iCZPVM65eE= =GJfH -----END PGP SIGNATURE----- --swragf7kp7z3ilk7--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20190508205245.ulbo6fusk3b4py7t>