From owner-freebsd-bugs@freebsd.org Mon Jan 16 10:00:52 2017 Return-Path: Delivered-To: freebsd-bugs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B5DEDCAF3B3 for ; Mon, 16 Jan 2017 10:00:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 9CCB31E17 for ; Mon, 16 Jan 2017 10:00:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v0GA0qbG091515 for ; Mon, 16 Jan 2017 10:00:52 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-bugs@FreeBSD.org Subject: [Bug 216134] linux emulation: panic in getdents when running (memory hungry) backup app using NFS [kernel core dump exists] Date: Mon, 16 Jan 2017 10:00:52 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: new X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: girgen@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-bugs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_id short_desc product version rep_platform op_sys bug_status bug_severity priority component assigned_to reporter Message-ID: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-bugs@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Bug reports List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 16 Jan 2017 10:00:52 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D216134 Bug ID: 216134 Summary: linux emulation: panic in getdents when running (memory hungry) backup app using NFS [kernel core dump exists] Product: Base System Version: 11.0-RELEASE Hardware: Any OS: Any Status: New Severity: Affects Only Me Priority: --- Component: kern Assignee: freebsd-bugs@FreeBSD.org Reporter: girgen@FreeBSD.org Hi, We run a FreeBSD-11.0-RELEASE-p6 system, GENERIC kernel. running in VMWare, 32GB, 4 cores.=20 open-vm-tools-nox11-1280544_16,1=20 linux_base-c6_64-6.8 The application is IBM:s Tivoli backup, TSM. It normally runs with no probl= ems, but last month it has shown a series of panics. We believe this is due to t= oo many files to backup. It tries to backup snapshot of the a file system moun= ted using NFS, so suddenly there where four times the exepected amount of files. TSM does not handle many files very good. Still, you would not expect the kernel to panic. This is not a resource problem. the memory graphs are flat until the crash, no warnings. Since the release binary version has no debug symbols (a separate bug?) I b= uilt a kernel to get a core dump consistent with the debug symbols. Seems the st= ack is corrupted though? Anything more I can do with this? Tips? # kgdb kernel.debug /var/crash/vmcore.3 GNU gdb 6.1.1 [FreeBSD] Copyright 2004 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain condition= s. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "amd64-marcel-freebsd"... Unread portion of the kernel message buffer: panic: vm_fault: fault on nofault entry, addr: fffffe0004aa9000 cpuid =3D 1 KDB: stack backtrace: #0 0xffffffff80b24077 at kdb_backtrace+0x67 #1 0xffffffff80ad93e2 at vpanic+0x182 #2 0xffffffff80ad9253 at panic+0x43 #3 0xffffffff80e12601 at vm_fault_hold+0x2721 #4 0xffffffff80e0fe98 at vm_fault+0x78 #5 0xffffffff80fa0e59 at trap_pfault+0xf9 #6 0xffffffff80fa04ec at trap+0x26c #7 0xffffffff80f84141 at calltrap+0x8 #8 0xffffffff80fa16ae at amd64_syscall+0x4ce #9 0xffffffff80f8442b at Xfast_syscall+0xfb Uptime: 11d0h40m52s Dumping 2657 out of 32735 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..= 91% Reading symbols from /boot/kernel/accf_data.ko...Reading symbols from /usr/lib/debug//boot/kernel/accf_data.ko.debug...done. done. Loaded symbols for /boot/kernel/accf_data.ko Reading symbols from /boot/kernel/accf_http.ko...Reading symbols from /usr/lib/debug//boot/kernel/accf_http.ko.debug...done. done. Loaded symbols for /boot/kernel/accf_http.ko Reading symbols from /boot/kernel/nullfs.ko...Reading symbols from /usr/lib/debug//boot/kernel/nullfs.ko.debug...done. done. Loaded symbols for /boot/kernel/nullfs.ko Reading symbols from /boot/kernel/linprocfs.ko...Reading symbols from /usr/lib/debug//boot/kernel/linprocfs.ko.debug...done. done. Loaded symbols for /boot/kernel/linprocfs.ko Reading symbols from /boot/kernel/linux_common.ko...Reading symbols from /usr/lib/debug//boot/kernel/linux_common.ko.debug...done. done. Loaded symbols for /boot/kernel/linux_common.ko Reading symbols from /usr/local/lib/vmware-tools/modules/drivers/vmmemctl.ko...done. Loaded symbols for /usr/local/lib/vmware-tools/modules/drivers/vmmemctl.ko Reading symbols from /usr/local/lib/vmware-tools/modules/drivers/vmxnet.ko...done. Loaded symbols for /usr/local/lib/vmware-tools/modules/drivers/vmxnet.ko Reading symbols from /usr/local/lib/vmware-tools/modules/drivers/vmblock.ko...done. Loaded symbols for /usr/local/lib/vmware-tools/modules/drivers/vmblock.ko Reading symbols from /usr/local/lib/vmware-tools/modules/drivers/vmhgfs.ko...done. Loaded symbols for /usr/local/lib/vmware-tools/modules/drivers/vmhgfs.ko Reading symbols from /boot/kernel/linux.ko...Reading symbols from /usr/lib/debug//boot/kernel/linux.ko.debug...done. done. Loaded symbols for /boot/kernel/linux.ko Reading symbols from /boot/kernel/linux64.ko...Reading symbols from /usr/lib/debug//boot/kernel/linux64.ko.debug...done. done. Loaded symbols for /boot/kernel/linux64.ko #0 doadump (textdump=3D) at pcpu.h:221 221 __asm("movq %%gs:%1,%0" : "=3Dr" (td) (kgdb) bt #0 doadump (textdump=3D) at pcpu.h:221 #1 0xffffffff80ad8e69 in kern_reboot (howto=3D260) at /usr/src/sys/kern/kern_shutdown.c:366 #2 0xffffffff80ad941b in vpanic (fmt=3D, ap=3D) at /usr/src/sys/kern/kern_shutdown.c:759 #3 0xffffffff80ad9253 in panic (fmt=3D0x0) at /usr/src/sys/kern/kern_shutdown.c:690 #4 0xffffffff80e12601 in vm_fault_hold (map=3D, vaddr=3D, fault_type=3D, fault_flags=3D, m_hold=3D) at /usr/src/sys/vm/vm_fault.c:330 #5 0xffffffff80e0fe98 in vm_fault (map=3D0xfffff80003000000, vaddr=3D, fault_type=3D1 '\001', fault_flags=3D)= at /usr/src/sys/vm/vm_fault.c:273 #6 0xffffffff80fa0e59 in trap_pfault (frame=3D0xfffffe085e0638d0, usermode= =3D0) at /usr/src/sys/amd64/amd64/trap.c:741 #7 0xffffffff80fa04ec in trap (frame=3D0xfffffe085e0638d0) at /usr/src/sys/amd64/amd64/trap.c:442 #8 0xffffffff80f84141 in calltrap () at /usr/src/sys/amd64/amd64/exception.S:236 #9 0xffffffff8248785a in getdents_common (td=3D, args=3D, is64bit=3D) at /usr/src/sys/modules/linux64/../../compat/linux/linux_file.c:416 #10 0xffffffff80fa16ae in amd64_syscall (td=3D, traced= =3D0) at subr_syscall.c:135 #11 0xffffffff80f8442b in Xfast_syscall () at /usr/src/sys/amd64/amd64/exception.S:396 #12 0x00000008034a8fc5 in ?? () Previous frame inner to this frame (corrupt stack?) Current language: auto; currently minimal (kgdb) --=20 You are receiving this mail because: You are the assignee for the bug.=