From owner-freebsd-stable@freebsd.org Mon Oct 5 10:07:51 2015 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 141329B2252 for ; Mon, 5 Oct 2015 10:07:51 +0000 (UTC) (envelope-from ck-lists@cksoft.de) Received: from mx1.cksoft.de (mx1.cksoft.de [IPv6:2001:67c:24f8:1::25:1]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mx1.cksoft.de", Issuer "CA" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id C89F41A1 for ; Mon, 5 Oct 2015 10:07:50 +0000 (UTC) (envelope-from ck-lists@cksoft.de) Received: from m.cksoft.de (m.cksoft.de [212.17.240.75]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mx1.cksoft.de (Postfix) with ESMTPSA id AD2731E9E6E for ; Mon, 5 Oct 2015 12:07:46 +0200 (CEST) Received: from amavis.cksoft.de (unknown [IPv6:2a01:170:1110:8001::25:a1]) by m.cksoft.de (Postfix) with ESMTP id 76A22631D0 for ; Mon, 5 Oct 2015 12:06:18 +0200 (CEST) X-Virus-Scanned: amavisd-new at cksoft.de Received: from m.cksoft.de ([192.168.64.93]) by amavis.cksoft.de (amavis.cksoft.de [192.168.64.94]) (amavisd-new, port 10041) with ESMTP id pftpdAUuQ0xg for ; Mon, 5 Oct 2015 12:06:17 +0200 (CEST) Received: from noc1.cksoft.de (noc1.cksoft.de [IPv6:2a01:170:1110:8001::53:1]) by m.cksoft.de (Postfix) with ESMTP id E1B8062F88 for ; Mon, 5 Oct 2015 12:06:15 +0200 (CEST) Received: by noc1.cksoft.de (Postfix, from userid 1000) id C30E913ECB; Mon, 5 Oct 2015 12:07:42 +0200 (CEST) Received: from localhost (localhost [127.0.0.1]) by noc1.cksoft.de (Postfix) with ESMTP id B7B2B13CF9 for ; Mon, 5 Oct 2015 12:07:42 +0200 (CEST) Date: Mon, 5 Oct 2015 12:07:42 +0200 (CEST) From: Christian Kratzer X-X-Sender: ck@noc1.cksoft.de Reply-To: Christian Kratzer To: freebsd-stable@freebsd.org Subject: smbfs crashes since approx. 10.1-RELEASE Message-ID: User-Agent: Alpine 2.20 (BSF 67 2015-01-07) X-Spammer-Kill-Ratio: 75% MIME-Version: 1.0 Content-Type: text/plain; format=flowed; charset=US-ASCII X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 05 Oct 2015 10:07:51 -0000 Hi, I run a regular rsync job that runs from cron and copies stuff that gets created on a Windows smbfs share. Starting about 10.1-RELEASE the VM has become unstable and started panicing. I have narrowed the issue down to the aforementioned rsync job. When I move the job to a different VM the the other VM starts crashing and the VM without the job becomes stable agin. I have panics and crashinfos stored in /var/crash if anybody is interested: root@noc2:/var/crash # uname -a FreeBSD noc2.cksoft.de 10.2-RELEASE FreeBSD 10.2-RELEASE #0 r286666: Wed Aug 12 15:26:37 UTC 2015 root@releng1.nyi.freebsd.org:/usr/obj/usr/src/sys/GENERIC amd64 root@noc2:/var/crash # freebsd-version -u 10.2-RELEASE-p5 root@noc2:/var/crash # freebsd-version -k 10.2-RELEASE root@noc2:/var/crash # This is what I have in /var/crash/core.txt.0 Fatal trap 12: page fault while in kernel mode cpuid = 0; apic id = 00 fault virtual address = 0x20 fault code = supervisor read data, page not present instruction pointer = 0x20:0xffffffff80996c7c stack pointer = 0x28:0xfffffe003d6c0ac0 frame pointer = 0x28:0xfffffe003d6c0af0 code segment = base 0x0, limit 0xfffff, type 0x1b = DPL 0, pres 1, long 1, def32 0, gran 1 processor eflags = resume, IOPL = 0 current process = 1349 (smbiod10) trap number = 12 panic: page fault cpuid = 0 KDB: stack backtrace: #0 0xffffffff80984e30 at kdb_backtrace+0x60 #1 0xffffffff809489e6 at vpanic+0x126 #2 0xffffffff809488b3 at panic+0x43 #3 0xffffffff80d4aadb at trap_fatal+0x36b #4 0xffffffff80d4addd at trap_pfault+0x2ed #5 0xffffffff80d4a47a at trap+0x47a #6 0xffffffff80d307f2 at calltrap+0x8 #7 0xffffffff8092ebe0 at __mtx_unlock_sleep+0x60 #8 0xffffffff8092eb69 at __mtx_unlock_flags+0x69 #9 0xffffffff81a1b724 at smb_iod_thread+0xb4 #10 0xffffffff8091244a at fork_exit+0x9a #11 0xffffffff80d30d2e at fork_trampoline+0xe Uptime: 2h43m55s Dumping 103 out of 999 MB: (CTRL-C to abort) ..16%..31%..47%..62%..78%..93% Reading symbols from /boot/kernel/smbfs.ko.symbols...done. Loaded symbols for /boot/kernel/smbfs.ko.symbols Reading symbols from /boot/kernel/libiconv.ko.symbols...done. Loaded symbols for /boot/kernel/libiconv.ko.symbols Reading symbols from /boot/kernel/libmchain.ko.symbols...done. Loaded symbols for /boot/kernel/libmchain.ko.symbols #0 doadump (textdump=) at pcpu.h:219 219 pcpu.h: No such file or directory. in pcpu.h (kgdb) #0 doadump (textdump=) at pcpu.h:219 #1 0xffffffff80948642 in kern_reboot (howto=260) at /usr/src/sys/kern/kern_shutdown.c:451 #2 0xffffffff80948a25 in vpanic (fmt=, ap=) at /usr/src/sys/kern/kern_shutdown.c:758 #3 0xffffffff809488b3 in panic (fmt=0x0) at /usr/src/sys/kern/kern_shutdown.c:687 #4 0xffffffff80d4aadb in trap_fatal (frame=, eva=) at /usr/src/sys/amd64/amd64/trap.c:851 #5 0xffffffff80d4addd in trap_pfault (frame=0xfffffe003d6c0a10, usermode=) at /usr/src/sys/amd64/amd64/trap.c:674 #6 0xffffffff80d4a47a in trap (frame=0xfffffe003d6c0a10) at /usr/src/sys/amd64/amd64/trap.c:440 #7 0xffffffff80d307f2 in calltrap () at /usr/src/sys/amd64/amd64/exception.S:236 #8 0xffffffff80996c7c in turnstile_broadcast (ts=0x0, queue=0) at /usr/src/sys/kern/subr_turnstile.c:838 #9 0xffffffff8092ebe0 in __mtx_unlock_sleep (c=0xfffff80002df0390, opts=, file=0xffffffff81a25801 "%s: Can't handle disordered parameters %d:%d\n", line=1) at /usr/src/sys/kern/kern_mutex.c:791 #10 0xffffffff8092eb69 in __mtx_unlock_flags (c=, opts=, file=0xffffffff81a25801 "%s: Can't handle disordered parameters %d:%d\n", line=1) at /usr/src/sys/kern/kern_mutex.c:254 #11 0xffffffff81a1b724 in smb_iod_thread (arg=0xfffff80002df0300) at /usr/src/sys/modules/smbfs/../../netsmb/smb_iod.c:624 #12 0xffffffff8091244a in fork_exit ( callout=0xffffffff81a1b670 , arg=0xfffff80002df0300, frame=0xfffffe003d6c0c00) at /usr/src/sys/kern/kern_fork.c:1018 #13 0xffffffff80d30d2e in fork_trampoline () at /usr/src/sys/amd64/amd64/exception.S:611 #14 0x0000000000000000 in ?? () Current language: auto; currently minimal (kgdb) Any tips on howto proceeed with this ? I can setup a dedicated VM with a fresh install of whatever in case it helps. Greetings Christian -- Christian Kratzer CK Software GmbH Email: ck@cksoft.de Wildberger Weg 24/2 Phone: +49 7032 893 997 - 0 D-71126 Gaeufelden Fax: +49 7032 893 997 - 9 HRB 245288, Amtsgericht Stuttgart Mobile: +49 171 1947 843 Geschaeftsfuehrer: Christian Kratzer Web: http://www.cksoft.de/